[ 571.302228] env[70764]: INFO neutron.common.config [-] Logging enabled! [ 571.302228] env[70764]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.1.0.dev83 [ 571.302228] env[70764]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=70764) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 571.302228] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 571.302228] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 571.303443] env[70764]: WARNING oslo_policy.policy [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 571.303443] env[70764]: WARNING oslo_policy.policy [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 571.304542] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] VMware NSXv3 Agent initialized successfully. [ 571.304904] env[70764]: DEBUG oslo_concurrency.lockutils [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] Acquiring lock "singleton_lock" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.305048] env[70764]: DEBUG oslo_concurrency.lockutils [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] Acquired lock "singleton_lock" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.306746] env[70764]: DEBUG oslo_concurrency.lockutils [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] Releasing lock "singleton_lock" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.306746] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] Full set of CONF: {{(pid=70764) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/eventlet/service.py:357}} [ 571.306746] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] ******************************************************************************** {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 571.306746] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] Configuration options gathered from: {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 571.306746] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 571.306746] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 571.307249] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] ================================================================================ {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 571.307249] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] agent_down_time = 75 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.307249] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] allow_automatic_dhcp_failover = True {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.307249] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] allow_bulk = True {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.307249] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] api_extensions_path = {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.307249] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] api_paste_config = api-paste.ini {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.307650] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] auth_strategy = keystone {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.307650] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] backdoor_port = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.307650] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] backdoor_socket = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.307650] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] backlog = 4096 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.307827] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] base_mac = fa:16:3e:00:00:00 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.307928] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] bind_host = 0.0.0.0 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.308083] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] bind_port = 9696 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.308162] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] client_socket_timeout = 900 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.308306] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] config_dir = [] {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.308419] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.308586] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] config_source = [] {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.308753] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] control_exchange = neutron {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.308965] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] core_plugin = ml2 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.309065] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] debug = True {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.309176] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] default_availability_zones = [] {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.309391] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.309537] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] dhcp_agent_notification = True {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.309677] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] dhcp_agents_per_network = 1 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.309818] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] dhcp_lease_duration = 86400 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.309964] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] dhcp_load_type = networks {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.310118] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] dns_domain = openstacklocal {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.310262] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.310398] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] enable_default_route_bfd = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.310536] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] enable_default_route_ecmp = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.310671] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] enable_dvr = True {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.310808] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] enable_new_agents = True {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.310964] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.311120] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] enable_signals = True {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.311260] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] enable_traditional_dhcp = True {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.311394] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] external_dns_driver = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.311530] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] filter_validation = True {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.311676] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] global_physnet_mtu = 8950 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.311817] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] graceful_shutdown_timeout = 60 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.311994] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] host = cpu-1 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.312148] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] host_dvr_for_dhcp = True {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.312290] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] http_retries = 3 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.312435] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] instance_format = [instance: %(uuid)s] {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.312588] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.312732] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] ipam_driver = internal {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.312857] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] ipv6_pd_enabled = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.313013] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] l3_ha = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.313156] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.313296] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] l3_ha_network_physical_name = {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.313436] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] l3_ha_network_type = {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.313578] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] log_color = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.313719] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] log_config_append = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.313857] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.313989] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] log_dir = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.314135] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] log_file = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.314246] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] log_options = True {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.314383] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] log_rotate_interval = 1 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.314526] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] log_rotate_interval_type = days {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.314667] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] log_rotation_type = none {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.314778] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.314885] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.315033] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.315174] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.315282] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.315419] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] max_dns_nameservers = 5 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.315555] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] max_header_line = 16384 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.315690] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] max_l3_agents_per_router = 3 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.315822] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] max_logfile_count = 30 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.315954] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] max_logfile_size_mb = 200 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.316136] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] max_subnet_host_routes = 20 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.316319] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] my_ip = 10.180.1.21 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.316485] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] my_ipv6 = ::1 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.316637] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] network_auto_schedule = True {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.316775] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] network_link_prefix = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.316919] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.317080] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] notify_nova_on_port_data_changes = True {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.317228] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] notify_nova_on_port_status_changes = True {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.317371] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] pagination_max_limit = -1 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.317508] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] publish_errors = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.317644] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] rate_limit_burst = 0 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.317789] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] rate_limit_except_level = CRITICAL {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.317924] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] rate_limit_interval = 0 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.318068] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] retry_until_window = 30 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.318207] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] router_distributed = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.318342] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] rpc_resources_processing_step = 20 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.318475] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] rpc_response_max_timeout = 600 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.318637] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] rpc_response_timeout = 60 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.318784] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] send_events_interval = 2 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.318937] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] service_plugins = ['router'] {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.319092] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] setproctitle = on {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.319226] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] shell_completion = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.319366] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] state_path = /opt/stack/data/neutron {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.319506] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] syslog_log_facility = LOG_USER {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.319644] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] tcp_keepidle = 600 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.319786] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] transport_url = **** {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.319923] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] use_journal = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.320075] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] use_json = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.320216] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] use_ssl = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.320352] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] use_stderr = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.320497] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] use_syslog = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.320634] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] vlan_qinq = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.320774] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] vlan_transparent = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.320925] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] watch_log_file = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.321087] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] wsgi_default_pool_size = 100 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.321228] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] wsgi_keep_alive = True {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.321373] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.321512] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] wsgi_server_debug = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 571.321663] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_concurrency.disable_process_locking = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.321813] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.321959] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.322111] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.322254] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.322394] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.322532] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.322683] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] profiler.connection_string = messaging:// {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.322829] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] profiler.enabled = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.322976] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] profiler.es_doc_type = notification {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.323126] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] profiler.es_scroll_size = 10000 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.323268] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] profiler.es_scroll_time = 2m {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.323405] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] profiler.filter_error_trace = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.323547] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] profiler.hmac_keys = **** {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.323688] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] profiler.sentinel_service_name = mymaster {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.323831] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] profiler.socket_timeout = 0.1 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.323970] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] profiler.trace_requests = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.324121] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] profiler.trace_sqlalchemy = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.324275] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] profiler_jaeger.process_tags = {} {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.324413] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] profiler_jaeger.service_name_prefix = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.324552] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] profiler_otlp.service_name_prefix = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.324707] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_policy.enforce_new_defaults = True {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.324964] env[70764]: WARNING oslo_config.cfg [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 571.325130] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_policy.enforce_scope = True {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.325278] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_policy.policy_default_rule = default {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.325430] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.325575] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.325721] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.325857] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.325992] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.326138] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.326275] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.326417] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_policy.remote_timeout = 60.0 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.326597] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.326753] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] agent.extensions = [] {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.326898] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.327059] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] service_providers.service_provider = [] {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.327209] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] QUOTAS.default_quota = -1 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.327357] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.327500] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] QUOTAS.quota_floatingip = 50 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.327642] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] QUOTAS.quota_network = 100 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.327781] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] QUOTAS.quota_port = 500 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.327922] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.328072] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] QUOTAS.quota_router = 10 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.328212] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] QUOTAS.quota_security_group = 10 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.328350] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.328491] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] QUOTAS.quota_subnet = 100 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.328644] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] QUOTAS.track_quota_usage = True {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.328804] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.328942] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] privsep.group = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.329093] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] privsep.helper_command = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.329240] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.329432] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] privsep.thread_pool_size = 8 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.329598] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] privsep.user = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.329750] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.329887] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] privsep_dhcp_release.group = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.330038] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] privsep_dhcp_release.helper_command = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.330187] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.330328] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.330463] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] privsep_dhcp_release.user = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.330608] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.330746] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] privsep_ovs_vsctl.group = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.330880] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] privsep_ovs_vsctl.helper_command = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.331030] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.331172] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.331306] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] privsep_ovs_vsctl.user = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.331448] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] privsep_namespace.capabilities = [21] {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.331581] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] privsep_namespace.group = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.331715] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] privsep_namespace.helper_command = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.331854] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.331995] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] privsep_namespace.thread_pool_size = 8 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.332139] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] privsep_namespace.user = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.332284] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] privsep_conntrack.capabilities = [12] {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.332417] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] privsep_conntrack.group = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.332549] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] privsep_conntrack.helper_command = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.332690] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.332826] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.332957] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] privsep_conntrack.user = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.333113] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] privsep_link.capabilities = [12, 21] {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.333248] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] privsep_link.group = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.333378] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] privsep_link.helper_command = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.333516] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.333652] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] privsep_link.thread_pool_size = 8 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.333785] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] privsep_link.user = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.333937] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.334092] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.334235] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] AGENT.continue_on_failed_promotions = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.334371] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] AGENT.dscp = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.334508] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] AGENT.dscp_inherit = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.334653] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] AGENT.force_mp_to_policy = True {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.334791] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] AGENT.locking_coordinator_url = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.334928] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] AGENT.log_agent_heartbeats = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.335073] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] AGENT.logging_expire = 1 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.335217] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.335354] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.335498] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] AGENT.polling_interval = 240 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.335639] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.335784] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.335925] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] AGENT.report_interval = 30.0 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.336079] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.336225] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.336369] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.336533] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] AGENT.sync_skew = 60 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.336682] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] AGENT.synchronization_queue_size = 20 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.336826] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] AGENT.use_helper_for_ns_read = True {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.336971] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] SECURITYGROUP.enable_ipset = True {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.337133] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] SECURITYGROUP.enable_security_group = True {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.337279] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.337423] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.337567] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] experimental.ipv6_pd_enabled = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.337726] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] ml2.extension_drivers = ['port_security'] {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.337862] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] ml2.external_network_type = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.338020] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.338170] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] ml2.overlay_ip_version = 4 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.338657] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] ml2.path_mtu = 8950 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.338657] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] ml2.physical_network_mtus = {} {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.338657] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] ml2.tenant_network_types = ['vlan'] {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.338773] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.338907] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] ml2.type_drivers = ['vlan'] {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.339068] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] AGENT_CLI.neutron_port_id = [] {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.339213] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.339357] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.339509] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.339660] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.339809] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.339955] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.340113] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.340261] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.340448] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.340599] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] NSXV3.nsxv3_login_password = **** {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.340786] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] NSXV3.nsxv3_login_port = 443 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.340953] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] NSXV3.nsxv3_login_user = admin {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.341141] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.341316] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.341482] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.341630] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.341803] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.341976] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.342166] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.342322] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.342486] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.342666] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.342857] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.343018] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.343180] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.343378] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.343539] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] vsphere.vsphere_login_password = VMware1! {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.343688] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.343832] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.343978] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] nova.auth_section = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.344141] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] nova.auth_type = password {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.344287] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.344425] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] nova.certfile = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.344564] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] nova.collect_timing = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.344711] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] nova.endpoint_type = public {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.344848] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] nova.insecure = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.344982] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] nova.keyfile = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.345140] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] nova.region_name = RegionOne {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.345279] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] nova.split_loggers = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.345413] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] nova.timeout = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.345560] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] placement.auth_section = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.345713] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] placement.auth_type = password {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.345859] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.345999] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] placement.certfile = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.346153] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] placement.collect_timing = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.346300] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] placement.endpoint_type = public {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.346466] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] placement.insecure = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.346607] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] placement.keyfile = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.346748] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] placement.region_name = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.346890] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] placement.split_loggers = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.347030] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] placement.timeout = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.347180] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] ironic.auth_section = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.347321] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] ironic.auth_type = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.347460] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] ironic.cafile = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.347595] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] ironic.certfile = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.347738] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] ironic.collect_timing = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.347876] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] ironic.connect_retries = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.348104] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] ironic.connect_retry_delay = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.348157] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] ironic.enable_notifications = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.348285] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] ironic.endpoint_override = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.348420] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] ironic.insecure = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.348616] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] ironic.interface = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.348704] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] ironic.keyfile = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.348841] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] ironic.max_version = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.348974] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] ironic.min_version = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.349120] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] ironic.region_name = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.349255] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] ironic.retriable_status_codes = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.349387] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] ironic.service_name = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.349525] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] ironic.service_type = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.349655] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] ironic.split_loggers = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.349781] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] ironic.status_code_retries = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.349913] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] ironic.status_code_retry_delay = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.350057] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] ironic.timeout = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.350192] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] ironic.valid_interfaces = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.350322] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] ironic.version = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.350465] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] cli_script.dry_run = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.350613] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.350752] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.350902] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.351062] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.351204] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.351339] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.351475] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.351611] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.351748] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.351892] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.352034] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.352178] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.352318] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.352457] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.352599] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.352750] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.352890] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.353039] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.353235] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.353326] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.353463] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.353604] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.353748] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.353890] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.354039] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.354182] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.354321] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.354462] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.354601] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.354742] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.354881] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_messaging_rabbit.ssl = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.355035] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.355183] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.355322] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.355466] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.355609] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_messaging_rabbit.ssl_version = {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.355749] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.355896] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_messaging_notifications.driver = [] {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.356047] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_messaging_notifications.retry = -1 {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.356206] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.356348] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 571.356513] env[70764]: DEBUG oslo_service.backend.eventlet.service [None req-80f22b15-d9ce-4420-82b6-1ea28bd412e9 None None] ******************************************************************************** {{(pid=70764) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 571.357452] env[70764]: DEBUG neutron.agent.securitygroups_rpc [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Init firewall settings (driver=nsxv3) {{(pid=70764) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 571.358760] env[70764]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=70764) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 571.359007] env[70764]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] RPC agent_id: nsxm-l-01a.corp.local [ 571.361217] env[70764]: DEBUG dogpile.cache.region [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 571.361341] env[70764]: DEBUG dogpile.lock [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 571.361481] env[70764]: DEBUG dogpile.lock [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 571.361531] env[70764]: DEBUG dogpile.lock [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 571.361633] env[70764]: DEBUG dogpile.cache.region [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 571.361725] env[70764]: DEBUG dogpile.lock [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 571.361848] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 571.387501] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Session token - acquiring [ 571.389045] env[70764]: DEBUG networking_nsxv3.common.locking [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.389226] env[70764]: DEBUG oslo_concurrency.lockutils [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.389335] env[70764]: DEBUG oslo_concurrency.lockutils [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.389764] env[70764]: DEBUG oslo_concurrency.lockutils [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.399354] env[70764]: DEBUG oslo_concurrency.lockutils [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.658229] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 571.682115] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 571.682247] env[70764]: DEBUG dogpile.cache.region [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Cache value generated in 0.320 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 571.682363] env[70764]: DEBUG dogpile.lock [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 571.682484] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Activating Policy API Provider. [ 571.682679] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Looking for the default Infrastructure Rules. [ 571.745092] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Looking for the Default Layer3 Logged Drop Section. [ 571.757300] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 571.757714] env[70764]: DEBUG networking_nsxv3.common.locking [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.757886] env[70764]: DEBUG oslo_concurrency.lockutils [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Acquiring lock "all" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.757992] env[70764]: DEBUG oslo_concurrency.lockutils [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Acquired lock "all" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.758274] env[70764]: DEBUG oslo_concurrency.lockutils [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Acquired external semaphore "all" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.758639] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.273877] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.775581] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.277905] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Inventory metadata is going to be refreshed. [ 573.278087] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 573.973646] env[70764]: DEBUG networking_nsxv3.common.locking [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.974087] env[70764]: DEBUG oslo_concurrency.lockutils [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.974087] env[70764]: DEBUG oslo_concurrency.lockutils [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.974278] env[70764]: DEBUG oslo_concurrency.lockutils [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.084918] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 574.085906] env[70764]: DEBUG oslo_concurrency.lockutils [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.086772] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 574.104832] env[70764]: DEBUG networking_nsxv3.common.locking [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.105039] env[70764]: DEBUG oslo_concurrency.lockutils [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.105170] env[70764]: DEBUG oslo_concurrency.lockutils [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.105418] env[70764]: DEBUG oslo_concurrency.lockutils [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.105541] env[70764]: DEBUG oslo_concurrency.lockutils [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.105688] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 574.105809] env[70764]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=70764) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 574.105918] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 574.128523] env[70764]: DEBUG networking_nsxv3.common.locking [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.128793] env[70764]: DEBUG oslo_concurrency.lockutils [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.128898] env[70764]: DEBUG oslo_concurrency.lockutils [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.129172] env[70764]: DEBUG oslo_concurrency.lockutils [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.129352] env[70764]: DEBUG oslo_concurrency.lockutils [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.129498] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 574.148657] env[70764]: DEBUG networking_nsxv3.common.locking [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.148929] env[70764]: DEBUG oslo_concurrency.lockutils [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.148967] env[70764]: DEBUG oslo_concurrency.lockutils [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.149273] env[70764]: DEBUG oslo_concurrency.lockutils [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.149419] env[70764]: DEBUG oslo_concurrency.lockutils [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.149564] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 574.166848] env[70764]: DEBUG networking_nsxv3.common.locking [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.167036] env[70764]: DEBUG oslo_concurrency.lockutils [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Acquiring lock "Address Group" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.167155] env[70764]: DEBUG oslo_concurrency.lockutils [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Acquired lock "Address Group" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.167389] env[70764]: DEBUG oslo_concurrency.lockutils [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Acquired external semaphore "Address Group" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.167527] env[70764]: DEBUG oslo_concurrency.lockutils [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Releasing lock "Address Group" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.167675] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 574.167783] env[70764]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=70764) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 574.167887] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 574.186723] env[70764]: DEBUG networking_nsxv3.common.locking [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.186970] env[70764]: DEBUG oslo_concurrency.lockutils [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Acquiring lock "Segment QoS" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.187110] env[70764]: DEBUG oslo_concurrency.lockutils [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Acquired lock "Segment QoS" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.187300] env[70764]: DEBUG oslo_concurrency.lockutils [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Acquired external semaphore "Segment QoS" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.187425] env[70764]: DEBUG oslo_concurrency.lockutils [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Releasing lock "Segment QoS" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.187567] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 574.187675] env[70764]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=70764) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 574.187783] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 574.205396] env[70764]: DEBUG networking_nsxv3.common.locking [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.205573] env[70764]: DEBUG oslo_concurrency.lockutils [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.205707] env[70764]: DEBUG oslo_concurrency.lockutils [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.205930] env[70764]: DEBUG oslo_concurrency.lockutils [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.206082] env[70764]: DEBUG oslo_concurrency.lockutils [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.206230] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 574.206338] env[70764]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70764) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 574.206441] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Inventory metadata have been refreshed. [ 574.206541] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Dryrun:True. Metadata refresh completed. [ 574.206660] env[70764]: DEBUG oslo_concurrency.lockutils [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Releasing lock "all" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.208310] env[70764]: INFO neutron.agent.agent_extensions_manager [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Loaded agent extensions: [] [ 574.209090] env[70764]: DEBUG neutron_lib.callbacks.manager [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=70764) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 574.257879] env[70764]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] NSXv3 Agent Agent RPC Daemon Started! [ 574.258019] env[70764]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] NSXv3 Agent Agent loop - iteration:0 started [ 574.259223] env[70764]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] NSXv3 Agent Agent out of sync with plugin! [ 579.209533] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 579.210017] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 584.210885] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 584.211263] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 588.256462] env[70764]: INFO networking_nsxv3.common.synchronization [None req-2fc157fe-5ba5-48ae-adeb-6034e3a28585 demo admin] Enqueued Resource ID: 7ebf9e8f-4105-4d5e-9533-acbb589e7f50 with Priority: HIGHEST for action security_group_rules [ 588.257055] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ebf9e8f-4105-4d5e-9533-acbb589e7f50 with Priority: HIGHEST for action security_group_rules [ 588.257351] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ebf9e8f-4105-4d5e-9533-acbb589e7f50 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.257472] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ebf9e8f-4105-4d5e-9533-acbb589e7f50" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.257538] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ebf9e8f-4105-4d5e-9533-acbb589e7f50" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.257902] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ebf9e8f-4105-4d5e-9533-acbb589e7f50" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.257996] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ebf9e8f-4105-4d5e-9533-acbb589e7f50',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.778457] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.778755] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.778755] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.778896] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.778991] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.779110] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ebf9e8f-4105-4d5e-9533-acbb589e7f50 already deleted. [ 588.779195] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ebf9e8f-4105-4d5e-9533-acbb589e7f50" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.258825] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 593.259209] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 598.260219] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 598.260493] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 603.212716] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.213154] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.213154] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.213154] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.213405] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.261267] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 603.261423] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 603.716446] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.218836] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.720645] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 604.720818] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 605.480428] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.480851] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.480851] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.480851] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.492279] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 605.493110] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.493967] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 605.510395] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.510532] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.510580] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.510777] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.510859] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.510963] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 605.511048] env[70764]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=70764) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 605.511120] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 605.560071] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.560241] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.560323] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.560478] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.560607] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.560715] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 605.580973] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.581125] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.581209] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.581352] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.581451] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.581566] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 605.600026] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.600229] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.600229] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.600375] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.600470] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.600577] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 605.600650] env[70764]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=70764) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 605.600720] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 605.616275] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.616423] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.616466] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.616609] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.616691] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.616787] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 605.616858] env[70764]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=70764) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 605.616929] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 605.635707] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.635824] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.635896] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.636050] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.636144] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.636243] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 605.636316] env[70764]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70764) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 605.636383] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 605.636451] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 605.636521] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 605.636583] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 605.636634] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 605.637306] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 605.637306] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 605.637306] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 605.654845] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.654975] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.654975] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.655159] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.655255] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.655353] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 605.670074] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.670218] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.670314] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.670491] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.670588] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.683443] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.262315] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 608.262809] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 613.263988] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 613.264274] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 613.403726] env[70764]: INFO networking_nsxv3.common.synchronization [None req-3ed3aa3d-6780-46ec-8af2-a0cf1d7fafdf None None] Enqueued Resource ID: feed673f-856c-42ba-ae35-183c40475275 with Priority: HIGHEST for action port [ 613.404220] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: feed673f-856c-42ba-ae35-183c40475275 with Priority: HIGHEST for action port [ 613.404532] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-feed673f-856c-42ba-ae35-183c40475275 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.404656] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-feed673f-856c-42ba-ae35-183c40475275" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.404723] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-feed673f-856c-42ba-ae35-183c40475275" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.404996] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-feed673f-856c-42ba-ae35-183c40475275" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.407134] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('feed673f-856c-42ba-ae35-183c40475275',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.564805] env[70764]: INFO networking_nsxv3.common.synchronization [None req-803bf409-adef-43e8-a427-8392432c48f9 None None] Enqueued Resource ID: f7166bc1-ed2a-4ea9-a5ed-bb8318ed764b with Priority: HIGHEST for action port [ 613.565079] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7166bc1-ed2a-4ea9-a5ed-bb8318ed764b with Priority: HIGHEST for action port [ 613.565629] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7166bc1-ed2a-4ea9-a5ed-bb8318ed764b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.565759] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7166bc1-ed2a-4ea9-a5ed-bb8318ed764b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.565834] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7166bc1-ed2a-4ea9-a5ed-bb8318ed764b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.566076] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7166bc1-ed2a-4ea9-a5ed-bb8318ed764b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.566162] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7166bc1-ed2a-4ea9-a5ed-bb8318ed764b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.910347] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port feed673f-856c-42ba-ae35-183c40475275 [ 613.910588] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.910722] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.910788] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.911028] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.911122] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.911312] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:feed673f-856c-42ba-ae35-183c40475275 already deleted. [ 613.911312] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-feed673f-856c-42ba-ae35-183c40475275" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.072240] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f7166bc1-ed2a-4ea9-a5ed-bb8318ed764b [ 614.072478] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.072620] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.072859] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.073028] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.073123] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.073277] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f7166bc1-ed2a-4ea9-a5ed-bb8318ed764b already deleted. [ 614.073328] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7166bc1-ed2a-4ea9-a5ed-bb8318ed764b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.450352] env[70764]: INFO networking_nsxv3.common.synchronization [None req-b8b80f22-35fd-421b-a380-bdc57511232e None None] Enqueued Resource ID: f02f6a40-73ab-474f-9a50-e8632a9551d3 with Priority: HIGHEST for action port [ 615.450793] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f02f6a40-73ab-474f-9a50-e8632a9551d3 with Priority: HIGHEST for action port [ 615.451540] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-f02f6a40-73ab-474f-9a50-e8632a9551d3 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.451763] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f02f6a40-73ab-474f-9a50-e8632a9551d3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.451763] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f02f6a40-73ab-474f-9a50-e8632a9551d3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.451971] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f02f6a40-73ab-474f-9a50-e8632a9551d3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.455174] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f02f6a40-73ab-474f-9a50-e8632a9551d3',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.758581] env[70764]: INFO networking_nsxv3.common.synchronization [None req-35e2613f-be78-44ad-a894-ebdbbd44f58d None None] Enqueued Resource ID: 65184adf-0053-44ce-b138-588717cc003d with Priority: HIGHEST for action port [ 615.758581] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65184adf-0053-44ce-b138-588717cc003d with Priority: HIGHEST for action port [ 615.758581] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-65184adf-0053-44ce-b138-588717cc003d taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.758581] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65184adf-0053-44ce-b138-588717cc003d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.758581] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65184adf-0053-44ce-b138-588717cc003d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.759593] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65184adf-0053-44ce-b138-588717cc003d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.759702] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65184adf-0053-44ce-b138-588717cc003d',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.958542] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f02f6a40-73ab-474f-9a50-e8632a9551d3 [ 615.958542] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.958542] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.958542] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.958542] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.958542] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.958542] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f02f6a40-73ab-474f-9a50-e8632a9551d3 already deleted. [ 615.958542] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f02f6a40-73ab-474f-9a50-e8632a9551d3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.262416] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 65184adf-0053-44ce-b138-588717cc003d [ 616.262679] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.262817] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.262891] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.263590] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.264183] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.264262] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:65184adf-0053-44ce-b138-588717cc003d already deleted. [ 616.264361] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65184adf-0053-44ce-b138-588717cc003d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.475882] env[70764]: INFO networking_nsxv3.common.synchronization [None req-4e98c65e-dfc6-4598-9638-32520248cb4d None None] Enqueued Resource ID: 101c22fe-ee28-460f-8b4f-f39751d0f06f with Priority: HIGHEST for action port [ 616.476229] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 101c22fe-ee28-460f-8b4f-f39751d0f06f with Priority: HIGHEST for action port [ 616.476723] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-101c22fe-ee28-460f-8b4f-f39751d0f06f taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.476826] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-101c22fe-ee28-460f-8b4f-f39751d0f06f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.476882] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-101c22fe-ee28-460f-8b4f-f39751d0f06f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.477116] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-101c22fe-ee28-460f-8b4f-f39751d0f06f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.477202] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('101c22fe-ee28-460f-8b4f-f39751d0f06f',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.982406] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 101c22fe-ee28-460f-8b4f-f39751d0f06f [ 616.982659] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.982804] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.982876] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.983119] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.983208] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.983300] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:101c22fe-ee28-460f-8b4f-f39751d0f06f already deleted. [ 616.983379] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-101c22fe-ee28-460f-8b4f-f39751d0f06f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.533411] env[70764]: INFO networking_nsxv3.common.synchronization [None req-2fb28f69-326a-481c-b1a5-a5385b5da070 None None] Enqueued Resource ID: 5c634139-4c29-4cc7-84a5-a0b0e6d0c255 with Priority: HIGHEST for action port [ 618.535076] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c634139-4c29-4cc7-84a5-a0b0e6d0c255 with Priority: HIGHEST for action port [ 618.536159] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c634139-4c29-4cc7-84a5-a0b0e6d0c255 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.536159] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c634139-4c29-4cc7-84a5-a0b0e6d0c255" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.536159] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c634139-4c29-4cc7-84a5-a0b0e6d0c255" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.536368] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c634139-4c29-4cc7-84a5-a0b0e6d0c255" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.536615] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c634139-4c29-4cc7-84a5-a0b0e6d0c255',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.602084] env[70764]: INFO networking_nsxv3.common.synchronization [None req-e9ded707-3489-4756-8a6d-174c904ddb05 None None] Enqueued Resource ID: f2407efb-63ac-44de-8163-8e8bc2d48a44 with Priority: HIGHEST for action port [ 618.602464] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2407efb-63ac-44de-8163-8e8bc2d48a44 with Priority: HIGHEST for action port [ 618.602928] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2407efb-63ac-44de-8163-8e8bc2d48a44 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.603079] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2407efb-63ac-44de-8163-8e8bc2d48a44" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.603170] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2407efb-63ac-44de-8163-8e8bc2d48a44" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.604453] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2407efb-63ac-44de-8163-8e8bc2d48a44" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.604453] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2407efb-63ac-44de-8163-8e8bc2d48a44',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.039277] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5c634139-4c29-4cc7-84a5-a0b0e6d0c255 [ 619.039547] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.039904] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.039904] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.040028] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.040066] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.040147] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5c634139-4c29-4cc7-84a5-a0b0e6d0c255 already deleted. [ 619.040227] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c634139-4c29-4cc7-84a5-a0b0e6d0c255" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.105732] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f2407efb-63ac-44de-8163-8e8bc2d48a44 [ 619.105999] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.106213] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.106213] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.106441] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.106568] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.106669] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f2407efb-63ac-44de-8163-8e8bc2d48a44 already deleted. [ 619.106861] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2407efb-63ac-44de-8163-8e8bc2d48a44" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.242310] env[70764]: INFO networking_nsxv3.common.synchronization [None req-4f7561a2-cf56-40d8-9280-d9c4c526ad41 None None] Enqueued Resource ID: 83041043-6308-48f8-a9c6-c54cc6a5d25c with Priority: HIGHEST for action port [ 619.242310] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83041043-6308-48f8-a9c6-c54cc6a5d25c with Priority: HIGHEST for action port [ 619.242310] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-83041043-6308-48f8-a9c6-c54cc6a5d25c taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.242310] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83041043-6308-48f8-a9c6-c54cc6a5d25c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.242726] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83041043-6308-48f8-a9c6-c54cc6a5d25c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.243296] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83041043-6308-48f8-a9c6-c54cc6a5d25c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.243983] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83041043-6308-48f8-a9c6-c54cc6a5d25c',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.746341] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 83041043-6308-48f8-a9c6-c54cc6a5d25c [ 619.746589] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.746887] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.746887] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.746988] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.747092] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.747187] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:83041043-6308-48f8-a9c6-c54cc6a5d25c already deleted. [ 619.747313] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83041043-6308-48f8-a9c6-c54cc6a5d25c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.767036] env[70764]: INFO networking_nsxv3.common.synchronization [req-f87e1d12-b3f8-4d49-b3a5-9481e5af1b10 req-cb840580-cc76-459f-a033-4d4d6e985c87 tempest-SecurityGroupRulesTestJSON-86292721 tempest-SecurityGroupRulesTestJSON-86292721-project-member] Enqueued Resource ID: 79fc1663-4c17-4f13-bb8e-7572f607af24 with Priority: HIGHEST for action security_group_rules [ 619.767344] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79fc1663-4c17-4f13-bb8e-7572f607af24 with Priority: HIGHEST for action security_group_rules [ 619.767644] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-79fc1663-4c17-4f13-bb8e-7572f607af24 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.768054] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-79fc1663-4c17-4f13-bb8e-7572f607af24" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.768054] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-79fc1663-4c17-4f13-bb8e-7572f607af24" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.768228] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-79fc1663-4c17-4f13-bb8e-7572f607af24" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.768228] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('79fc1663-4c17-4f13-bb8e-7572f607af24',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.295145] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.295248] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.295287] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.295494] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.295587] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.295681] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 79fc1663-4c17-4f13-bb8e-7572f607af24 already deleted. [ 620.295771] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-79fc1663-4c17-4f13-bb8e-7572f607af24" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.361984] env[70764]: INFO networking_nsxv3.common.synchronization [None req-16f15ca1-d00e-4cf9-b9b9-0978a47a6dd9 None None] Enqueued Resource ID: ffd2e55b-03b4-475b-bfdd-5ba3fd688f4c with Priority: HIGHEST for action port [ 620.362593] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffd2e55b-03b4-475b-bfdd-5ba3fd688f4c with Priority: HIGHEST for action port [ 620.362902] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-ffd2e55b-03b4-475b-bfdd-5ba3fd688f4c taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.363039] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ffd2e55b-03b4-475b-bfdd-5ba3fd688f4c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.363111] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ffd2e55b-03b4-475b-bfdd-5ba3fd688f4c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.364099] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ffd2e55b-03b4-475b-bfdd-5ba3fd688f4c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.364199] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffd2e55b-03b4-475b-bfdd-5ba3fd688f4c',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.866203] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ffd2e55b-03b4-475b-bfdd-5ba3fd688f4c [ 620.866442] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.866581] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.866704] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.866922] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.867017] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.867120] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ffd2e55b-03b4-475b-bfdd-5ba3fd688f4c already deleted. [ 620.867192] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ffd2e55b-03b4-475b-bfdd-5ba3fd688f4c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.158518] env[70764]: INFO networking_nsxv3.common.synchronization [None req-e5cab322-ab75-4385-a45b-86b89d5762c2 None None] Enqueued Resource ID: c9a20590-74bf-49d8-8282-4c78e6956b7e with Priority: HIGHEST for action port [ 621.158518] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9a20590-74bf-49d8-8282-4c78e6956b7e with Priority: HIGHEST for action port [ 621.158998] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9a20590-74bf-49d8-8282-4c78e6956b7e taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.158998] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9a20590-74bf-49d8-8282-4c78e6956b7e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.158998] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9a20590-74bf-49d8-8282-4c78e6956b7e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.159661] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9a20590-74bf-49d8-8282-4c78e6956b7e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.160095] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9a20590-74bf-49d8-8282-4c78e6956b7e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.662805] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c9a20590-74bf-49d8-8282-4c78e6956b7e [ 621.663073] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.663208] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.663275] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.663479] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.663565] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.663655] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c9a20590-74bf-49d8-8282-4c78e6956b7e already deleted. [ 621.663732] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9a20590-74bf-49d8-8282-4c78e6956b7e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.760433] env[70764]: INFO networking_nsxv3.common.synchronization [None req-2808cb35-17a3-46e3-9d60-9ddb988fe06a None None] Enqueued Resource ID: 54ecf7fb-d0f7-4406-adc5-bfdbc7f8c3ba with Priority: HIGHEST for action port [ 621.760433] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54ecf7fb-d0f7-4406-adc5-bfdbc7f8c3ba with Priority: HIGHEST for action port [ 621.761089] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-54ecf7fb-d0f7-4406-adc5-bfdbc7f8c3ba taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.761089] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54ecf7fb-d0f7-4406-adc5-bfdbc7f8c3ba" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.761215] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54ecf7fb-d0f7-4406-adc5-bfdbc7f8c3ba" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.761405] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54ecf7fb-d0f7-4406-adc5-bfdbc7f8c3ba" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.761490] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54ecf7fb-d0f7-4406-adc5-bfdbc7f8c3ba',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.263721] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 54ecf7fb-d0f7-4406-adc5-bfdbc7f8c3ba [ 622.264204] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.264360] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.264432] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.264651] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.264744] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.264840] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:54ecf7fb-d0f7-4406-adc5-bfdbc7f8c3ba already deleted. [ 622.264926] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54ecf7fb-d0f7-4406-adc5-bfdbc7f8c3ba" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.202212] env[70764]: INFO networking_nsxv3.common.synchronization [None req-b6132fa3-3036-4039-aa15-c71e77f32468 None None] Enqueued Resource ID: 73c02f1c-4ecb-467f-9f7c-68f9bb997fc9 with Priority: HIGHEST for action port [ 623.202212] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73c02f1c-4ecb-467f-9f7c-68f9bb997fc9 with Priority: HIGHEST for action port [ 623.202304] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-73c02f1c-4ecb-467f-9f7c-68f9bb997fc9 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.202427] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73c02f1c-4ecb-467f-9f7c-68f9bb997fc9" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.202505] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73c02f1c-4ecb-467f-9f7c-68f9bb997fc9" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.202747] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73c02f1c-4ecb-467f-9f7c-68f9bb997fc9" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.202825] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73c02f1c-4ecb-467f-9f7c-68f9bb997fc9',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.708743] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 73c02f1c-4ecb-467f-9f7c-68f9bb997fc9 [ 623.708991] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.709513] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.709513] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.710938] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.710938] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.710938] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:73c02f1c-4ecb-467f-9f7c-68f9bb997fc9 already deleted. [ 623.710938] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73c02f1c-4ecb-467f-9f7c-68f9bb997fc9" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.851220] env[70764]: INFO networking_nsxv3.common.synchronization [None req-53889659-e356-469c-aab1-8fa5f32613ab None None] Enqueued Resource ID: 2a095286-a851-4439-b5f5-d5bb5a1f63cb with Priority: HIGHEST for action port [ 623.851491] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a095286-a851-4439-b5f5-d5bb5a1f63cb with Priority: HIGHEST for action port [ 623.852081] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a095286-a851-4439-b5f5-d5bb5a1f63cb taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.852218] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a095286-a851-4439-b5f5-d5bb5a1f63cb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.852269] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a095286-a851-4439-b5f5-d5bb5a1f63cb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.852512] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a095286-a851-4439-b5f5-d5bb5a1f63cb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.852600] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a095286-a851-4439-b5f5-d5bb5a1f63cb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.355484] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2a095286-a851-4439-b5f5-d5bb5a1f63cb [ 624.355929] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.356086] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.356156] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.356374] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.356976] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.356976] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2a095286-a851-4439-b5f5-d5bb5a1f63cb already deleted. [ 624.356976] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a095286-a851-4439-b5f5-d5bb5a1f63cb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.469853] env[70764]: INFO networking_nsxv3.common.synchronization [req-5298fb33-742c-4587-abed-a1c5a8dceff7 req-125c2585-cbb6-41ac-856c-f10567b882d9 tempest-SecurityGroupRulesTestJSON-86292721 tempest-SecurityGroupRulesTestJSON-86292721-project-member] Enqueued Resource ID: 1c10c14a-9086-4e83-978b-3b2203e3877b with Priority: HIGHEST for action security_group_rules [ 624.469853] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c10c14a-9086-4e83-978b-3b2203e3877b with Priority: HIGHEST for action security_group_rules [ 624.469853] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c10c14a-9086-4e83-978b-3b2203e3877b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.469853] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c10c14a-9086-4e83-978b-3b2203e3877b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.469853] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c10c14a-9086-4e83-978b-3b2203e3877b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.473949] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c10c14a-9086-4e83-978b-3b2203e3877b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.474078] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c10c14a-9086-4e83-978b-3b2203e3877b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.954308] env[70764]: INFO networking_nsxv3.common.synchronization [None req-10d987df-64b2-42c3-8461-4dba81f80832 None None] Enqueued Resource ID: 6a1ffebc-b066-4796-9635-82304e999b07 with Priority: HIGHEST for action port [ 624.955666] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a1ffebc-b066-4796-9635-82304e999b07 with Priority: HIGHEST for action port [ 624.956076] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a1ffebc-b066-4796-9635-82304e999b07 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.957371] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a1ffebc-b066-4796-9635-82304e999b07" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.957371] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a1ffebc-b066-4796-9635-82304e999b07" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.957371] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a1ffebc-b066-4796-9635-82304e999b07" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.957371] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a1ffebc-b066-4796-9635-82304e999b07',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.994222] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.994517] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.994621] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.994980] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.994980] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.995129] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c10c14a-9086-4e83-978b-3b2203e3877b already deleted. [ 624.995253] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c10c14a-9086-4e83-978b-3b2203e3877b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.461126] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6a1ffebc-b066-4796-9635-82304e999b07 [ 625.461411] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.461532] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.461608] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.461789] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.461883] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.461989] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6a1ffebc-b066-4796-9635-82304e999b07 already deleted. [ 625.462094] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a1ffebc-b066-4796-9635-82304e999b07" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.655558] env[70764]: INFO networking_nsxv3.common.synchronization [None req-d53a109e-06fb-4618-8a7a-a564e257540d None None] Enqueued Resource ID: 67d2210b-2ff4-4f7a-9ae5-ed2cfb706227 with Priority: HIGHEST for action port [ 625.655558] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67d2210b-2ff4-4f7a-9ae5-ed2cfb706227 with Priority: HIGHEST for action port [ 625.655723] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-67d2210b-2ff4-4f7a-9ae5-ed2cfb706227 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.655824] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-67d2210b-2ff4-4f7a-9ae5-ed2cfb706227" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.655891] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-67d2210b-2ff4-4f7a-9ae5-ed2cfb706227" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.658273] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-67d2210b-2ff4-4f7a-9ae5-ed2cfb706227" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.658706] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67d2210b-2ff4-4f7a-9ae5-ed2cfb706227',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.162271] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 67d2210b-2ff4-4f7a-9ae5-ed2cfb706227 [ 626.162271] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.162271] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.162271] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.162271] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.162271] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.162271] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:67d2210b-2ff4-4f7a-9ae5-ed2cfb706227 already deleted. [ 626.162271] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-67d2210b-2ff4-4f7a-9ae5-ed2cfb706227" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.767617] env[70764]: INFO networking_nsxv3.common.synchronization [None req-42d72304-7611-4419-8693-3b60427a0f18 None None] Enqueued Resource ID: 03c42c76-bce7-4bc8-8c84-16f0fd850587 with Priority: HIGHEST for action port [ 626.767617] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03c42c76-bce7-4bc8-8c84-16f0fd850587 with Priority: HIGHEST for action port [ 626.767617] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-03c42c76-bce7-4bc8-8c84-16f0fd850587 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.767617] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03c42c76-bce7-4bc8-8c84-16f0fd850587" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.767617] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03c42c76-bce7-4bc8-8c84-16f0fd850587" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.770023] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03c42c76-bce7-4bc8-8c84-16f0fd850587" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.770070] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03c42c76-bce7-4bc8-8c84-16f0fd850587',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.131045] env[70764]: INFO networking_nsxv3.common.synchronization [req-dd1047e0-2cbe-4455-90f9-3fce3ea2a83b req-e8379e57-374a-4d40-aef3-36f6323b9b2e tempest-ImagesOneServerNegativeTestJSON-1318507346 tempest-ImagesOneServerNegativeTestJSON-1318507346-project-member] Enqueued Resource ID: 2a93825c-656b-4f3f-b946-3346edd746bf with Priority: HIGHEST for action security_group_members [ 627.131045] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a93825c-656b-4f3f-b946-3346edd746bf with Priority: HIGHEST for action security_group_members [ 627.131045] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a93825c-656b-4f3f-b946-3346edd746bf taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.131045] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.131461] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.133759] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.133759] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.133759] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.133759] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.133759] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.133759] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.133759] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a93825c-656b-4f3f-b946-3346edd746bf',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.272862] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 03c42c76-bce7-4bc8-8c84-16f0fd850587 [ 627.273339] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.273339] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.273339] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.273528] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.273620] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.273718] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:03c42c76-bce7-4bc8-8c84-16f0fd850587 already deleted. [ 627.274217] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03c42c76-bce7-4bc8-8c84-16f0fd850587" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.555414] env[70764]: INFO networking_nsxv3.common.synchronization [None req-dae69288-3c3b-49c1-b637-7e4d4dc90313 None None] Enqueued Resource ID: e622492a-2265-450a-95c9-142208e8af92 with Priority: HIGHEST for action port [ 627.555928] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e622492a-2265-450a-95c9-142208e8af92 with Priority: HIGHEST for action port [ 627.556242] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-e622492a-2265-450a-95c9-142208e8af92 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.556364] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e622492a-2265-450a-95c9-142208e8af92" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.556469] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e622492a-2265-450a-95c9-142208e8af92" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.556722] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e622492a-2265-450a-95c9-142208e8af92" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.556759] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e622492a-2265-450a-95c9-142208e8af92',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.636230] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.636403] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.636478] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.636714] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.636824] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.637219] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.637219] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.637219] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.637356] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.637458] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.637547] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a93825c-656b-4f3f-b946-3346edd746bf already deleted. [ 627.637633] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.064455] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e622492a-2265-450a-95c9-142208e8af92 [ 628.064596] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.064729] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.064800] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.065023] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.065114] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.065441] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e622492a-2265-450a-95c9-142208e8af92 already deleted. [ 628.066547] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e622492a-2265-450a-95c9-142208e8af92" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.420412] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-340 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.420737] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-340" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.420737] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-340" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.421091] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-340" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.421307] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.421465] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.421601] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.422009] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.422064] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.425404] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 628.425533] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 628.425650] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 628.425763] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 628.425879] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 628.425989] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 628.426153] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 628.445513] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 628.445513] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 628.445513] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 628.445698] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-340" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.446273] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-a1854c70-1325-48eb-9d44-b3da9605f220 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.446273] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-a1854c70-1325-48eb-9d44-b3da9605f220" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.446440] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-a1854c70-1325-48eb-9d44-b3da9605f220" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.447632] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-a1854c70-1325-48eb-9d44-b3da9605f220" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.447632] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1854c70-1325-48eb-9d44-b3da9605f220',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.628822] env[70764]: INFO networking_nsxv3.common.synchronization [None req-2327fad2-775c-4d1c-ab1b-ca995f32f0ae None None] Enqueued Resource ID: ac223c9d-4de8-4a63-af8d-2211f8515b8a with Priority: HIGHEST for action port [ 628.628822] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac223c9d-4de8-4a63-af8d-2211f8515b8a with Priority: HIGHEST for action port [ 628.628822] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac223c9d-4de8-4a63-af8d-2211f8515b8a taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.628822] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac223c9d-4de8-4a63-af8d-2211f8515b8a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.628822] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac223c9d-4de8-4a63-af8d-2211f8515b8a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.628822] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac223c9d-4de8-4a63-af8d-2211f8515b8a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.628822] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac223c9d-4de8-4a63-af8d-2211f8515b8a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.956262] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.956487] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.956617] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.956891] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.957056] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.957272] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port a1854c70-1325-48eb-9d44-b3da9605f220 not found, creating... [ 628.957541] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.957706] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.957818] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.958046] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.958180] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.958587] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.958699] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.958990] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.960987] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.961154] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.961314] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: a1854c70-1325-48eb-9d44-b3da9605f220 is going to be created. [ 628.987571] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.987571] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.987571] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.987571] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.987571] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.987571] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-a1854c70-1325-48eb-9d44-b3da9605f220" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.135163] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ac223c9d-4de8-4a63-af8d-2211f8515b8a [ 629.135163] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.135163] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.135163] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.135163] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.135425] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.135425] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ac223c9d-4de8-4a63-af8d-2211f8515b8a already deleted. [ 629.135489] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac223c9d-4de8-4a63-af8d-2211f8515b8a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.306310] env[70764]: INFO networking_nsxv3.common.synchronization [req-81b9e177-359f-41ba-93b7-28554ce58817 req-b5a38530-5fb9-4849-b812-f7fbc2995031 tempest-DeleteServersAdminTestJSON-513793110 tempest-DeleteServersAdminTestJSON-513793110-project-member] Enqueued Resource ID: 053f53ee-d0a4-4067-829d-5dc886808f18 with Priority: HIGHEST for action security_group_members [ 629.306310] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 053f53ee-d0a4-4067-829d-5dc886808f18 with Priority: HIGHEST for action security_group_members [ 629.306310] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-053f53ee-d0a4-4067-829d-5dc886808f18 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.306310] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.306310] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.306310] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.306310] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.306310] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.306577] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.306577] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.306577] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.306714] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('053f53ee-d0a4-4067-829d-5dc886808f18',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.380174] env[70764]: INFO networking_nsxv3.common.synchronization [None req-b2dd5dc7-f5c6-415a-9779-fe27fa6be3b4 None None] Enqueued Resource ID: ca0b96d4-970c-48e4-8a48-1d1d33be35a5 with Priority: HIGHEST for action port [ 629.380729] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca0b96d4-970c-48e4-8a48-1d1d33be35a5 with Priority: HIGHEST for action port [ 629.381314] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca0b96d4-970c-48e4-8a48-1d1d33be35a5 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.381441] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca0b96d4-970c-48e4-8a48-1d1d33be35a5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.381510] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca0b96d4-970c-48e4-8a48-1d1d33be35a5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.383234] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca0b96d4-970c-48e4-8a48-1d1d33be35a5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.383323] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca0b96d4-970c-48e4-8a48-1d1d33be35a5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.809239] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.809562] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.809562] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.809726] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.809820] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.810117] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.810117] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.810232] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.810339] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.810426] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.810601] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 053f53ee-d0a4-4067-829d-5dc886808f18 already deleted. [ 629.810709] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.885708] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ca0b96d4-970c-48e4-8a48-1d1d33be35a5 [ 629.885941] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.886097] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.886166] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.886362] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.886447] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.886537] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ca0b96d4-970c-48e4-8a48-1d1d33be35a5 already deleted. [ 629.886616] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca0b96d4-970c-48e4-8a48-1d1d33be35a5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.264848] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-343 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.265078] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-343" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.265211] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-343" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.265538] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-343" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.265809] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.265969] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.266635] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.266890] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.267292] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.267498] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 630.267613] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 630.267723] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 630.267847] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 630.267942] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 630.268692] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 630.269010] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 630.281650] env[70764]: INFO networking_nsxv3.common.synchronization [req-24e0cec9-1aba-4927-a766-a57b98bf7461 req-ef330128-9f9a-40e2-8528-8dfbea31527d tempest-SecurityGroupRulesTestJSON-86292721 tempest-SecurityGroupRulesTestJSON-86292721-project-member] Enqueued Resource ID: f7aa32be-823a-47df-bbcd-ae13cb1fb12f with Priority: HIGHEST for action security_group_rules [ 630.282126] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7aa32be-823a-47df-bbcd-ae13cb1fb12f with Priority: HIGHEST for action security_group_rules [ 630.282465] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7aa32be-823a-47df-bbcd-ae13cb1fb12f taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.282586] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7aa32be-823a-47df-bbcd-ae13cb1fb12f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.282655] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7aa32be-823a-47df-bbcd-ae13cb1fb12f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.282885] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7aa32be-823a-47df-bbcd-ae13cb1fb12f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.283622] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7aa32be-823a-47df-bbcd-ae13cb1fb12f',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.288763] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 630.289031] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 630.289193] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 630.290110] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-343" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.290110] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-aa39baa7-bf4f-413d-bc00-3021fcfda607 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.290249] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-aa39baa7-bf4f-413d-bc00-3021fcfda607" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.290295] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-aa39baa7-bf4f-413d-bc00-3021fcfda607" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.290580] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-aa39baa7-bf4f-413d-bc00-3021fcfda607" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.290718] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa39baa7-bf4f-413d-bc00-3021fcfda607',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.339187] env[70764]: INFO networking_nsxv3.common.synchronization [req-dd1047e0-2cbe-4455-90f9-3fce3ea2a83b req-09273482-06d6-466d-8d60-7a17d6de4006 service nova] Enqueued Resource ID: 2a93825c-656b-4f3f-b946-3346edd746bf with Priority: HIGHEST for action security_group_rules [ 630.339187] env[70764]: INFO networking_nsxv3.common.synchronization [req-dd1047e0-2cbe-4455-90f9-3fce3ea2a83b req-09273482-06d6-466d-8d60-7a17d6de4006 service nova] Enqueued Resource ID: 2a93825c-656b-4f3f-b946-3346edd746bf with Priority: HIGHEST for action security_group_members [ 630.339187] env[70764]: INFO networking_nsxv3.common.synchronization [req-dd1047e0-2cbe-4455-90f9-3fce3ea2a83b req-09273482-06d6-466d-8d60-7a17d6de4006 service nova] Enqueued Resource ID: a1854c70-1325-48eb-9d44-b3da9605f220 with Priority: HIGHEST for action port [ 630.339800] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a93825c-656b-4f3f-b946-3346edd746bf with Priority: HIGHEST for action security_group_rules [ 630.340024] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a93825c-656b-4f3f-b946-3346edd746bf with Priority: HIGHEST for action security_group_members [ 630.340104] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1854c70-1325-48eb-9d44-b3da9605f220 with Priority: HIGHEST for action port [ 630.340332] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a93825c-656b-4f3f-b946-3346edd746bf taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.342266] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.342533] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.342645] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.342706] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a93825c-656b-4f3f-b946-3346edd746bf',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.344799] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a93825c-656b-4f3f-b946-3346edd746bf taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.345029] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.345029] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.345170] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.345319] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.345415] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.345478] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.345619] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.345705] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.345799] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a93825c-656b-4f3f-b946-3346edd746bf',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.347204] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1854c70-1325-48eb-9d44-b3da9605f220 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.347315] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1854c70-1325-48eb-9d44-b3da9605f220" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.347766] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1854c70-1325-48eb-9d44-b3da9605f220" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.347766] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1854c70-1325-48eb-9d44-b3da9605f220" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.347766] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1854c70-1325-48eb-9d44-b3da9605f220',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.594044] env[70764]: INFO networking_nsxv3.common.synchronization [None req-e85f6294-1c55-458a-ace8-2a42dd67cd96 None None] Enqueued Resource ID: 09b06a32-b299-4f81-95c5-2fc54a6a7732 with Priority: HIGHEST for action port [ 630.594044] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09b06a32-b299-4f81-95c5-2fc54a6a7732 with Priority: HIGHEST for action port [ 630.594044] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-09b06a32-b299-4f81-95c5-2fc54a6a7732 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.594276] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-09b06a32-b299-4f81-95c5-2fc54a6a7732" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.594421] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-09b06a32-b299-4f81-95c5-2fc54a6a7732" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.595957] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-09b06a32-b299-4f81-95c5-2fc54a6a7732" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.598326] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09b06a32-b299-4f81-95c5-2fc54a6a7732',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.796234] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.796477] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.796587] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.796856] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.796997] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.797166] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port aa39baa7-bf4f-413d-bc00-3021fcfda607 not found, creating... [ 630.797426] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.797578] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.797689] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.798027] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.798098] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.799392] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.799392] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.799392] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.799392] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.799392] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.799392] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: aa39baa7-bf4f-413d-bc00-3021fcfda607 is going to be created. [ 630.804875] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.804994] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.805076] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.805252] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.805328] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.805415] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7aa32be-823a-47df-bbcd-ae13cb1fb12f already deleted. [ 630.805497] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7aa32be-823a-47df-bbcd-ae13cb1fb12f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.827162] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.827162] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.827162] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.827162] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.827162] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.827162] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-aa39baa7-bf4f-413d-bc00-3021fcfda607" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.850027] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a93825c-656b-4f3f-b946-3346edd746bf taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.850169] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.860806] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a93825c-656b-4f3f-b946-3346edd746bf',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.861677] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a1854c70-1325-48eb-9d44-b3da9605f220 with status ACTIVE [ 630.861882] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.862029] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.862082] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.862333] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.862425] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.862624] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.862694] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.862757] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.862894] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.863090] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.863146] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.863241] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.863298] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.863442] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.863505] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.863585] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a1854c70-1325-48eb-9d44-b3da9605f220 is going to be updated. [ 630.898673] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.898867] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.898923] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.899093] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.899223] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.899472] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1854c70-1325-48eb-9d44-b3da9605f220" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.099064] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 09b06a32-b299-4f81-95c5-2fc54a6a7732 [ 631.099297] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.099428] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.099493] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.099756] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.099846] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.099918] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:09b06a32-b299-4f81-95c5-2fc54a6a7732 already deleted. [ 631.099995] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-09b06a32-b299-4f81-95c5-2fc54a6a7732" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.322112] env[70764]: INFO networking_nsxv3.common.synchronization [req-91477307-bc72-4225-ae8d-62c9b73f6b87 req-53ed9c23-981c-4e20-ac36-6936eab2fa6b tempest-ServerDiagnosticsTest-1379378422 tempest-ServerDiagnosticsTest-1379378422-project-member] Enqueued Resource ID: 8e62e528-352b-40bb-8f9d-c7bb50b75dff with Priority: HIGHEST for action security_group_members [ 631.322425] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e62e528-352b-40bb-8f9d-c7bb50b75dff with Priority: HIGHEST for action security_group_members [ 631.322757] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e62e528-352b-40bb-8f9d-c7bb50b75dff taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.322882] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e62e528-352b-40bb-8f9d-c7bb50b75dff" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.322944] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e62e528-352b-40bb-8f9d-c7bb50b75dff" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.323521] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e62e528-352b-40bb-8f9d-c7bb50b75dff" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.324916] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.324916] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.324916] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.324916] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.324916] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.324916] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e62e528-352b-40bb-8f9d-c7bb50b75dff',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.330969] env[70764]: INFO networking_nsxv3.common.synchronization [None req-3f3aa2b6-cc70-4c2a-b46c-963d642915fb None None] Enqueued Resource ID: e53bff1c-7468-477d-993f-c61bc3b6b1ae with Priority: HIGHEST for action port [ 631.332200] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e53bff1c-7468-477d-993f-c61bc3b6b1ae with Priority: HIGHEST for action port [ 631.332200] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-e53bff1c-7468-477d-993f-c61bc3b6b1ae taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.332385] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e53bff1c-7468-477d-993f-c61bc3b6b1ae" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.332385] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e53bff1c-7468-477d-993f-c61bc3b6b1ae" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.334017] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e53bff1c-7468-477d-993f-c61bc3b6b1ae" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.334017] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e53bff1c-7468-477d-993f-c61bc3b6b1ae',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.366207] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a93825c-656b-4f3f-b946-3346edd746bf',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.605337] env[70764]: INFO networking_nsxv3.common.synchronization [None req-a8d7aeec-2024-4051-bd38-2490cf521d61 None None] Enqueued Resource ID: d7651b0e-7703-42a8-bc1c-48c06ccd6ccf with Priority: HIGHEST for action port [ 631.605337] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7651b0e-7703-42a8-bc1c-48c06ccd6ccf with Priority: HIGHEST for action port [ 631.605337] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7651b0e-7703-42a8-bc1c-48c06ccd6ccf taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.605337] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7651b0e-7703-42a8-bc1c-48c06ccd6ccf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.605337] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7651b0e-7703-42a8-bc1c-48c06ccd6ccf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.605884] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7651b0e-7703-42a8-bc1c-48c06ccd6ccf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.606224] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7651b0e-7703-42a8-bc1c-48c06ccd6ccf',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.832376] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.832655] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.832655] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.832843] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.832934] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.833152] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.833250] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.833326] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.833463] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.833561] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.833650] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e62e528-352b-40bb-8f9d-c7bb50b75dff already deleted. [ 631.833752] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e62e528-352b-40bb-8f9d-c7bb50b75dff" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.835149] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e53bff1c-7468-477d-993f-c61bc3b6b1ae [ 631.835335] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.835440] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.835505] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.835654] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.835735] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.835822] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e53bff1c-7468-477d-993f-c61bc3b6b1ae already deleted. [ 631.835900] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e53bff1c-7468-477d-993f-c61bc3b6b1ae" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.873239] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.873239] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.873239] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.873555] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.877017] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.877017] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a93825c-656b-4f3f-b946-3346edd746bf is going to be created. [ 631.877805] env[70764]: INFO networking_nsxv3.common.synchronization [None req-5d040a64-627b-497d-b57a-9f2b79e13c27 tempest-VolumesAssistedSnapshotsTest-491546016 tempest-VolumesAssistedSnapshotsTest-491546016-project-member] Enqueued Resource ID: f83113a5-bbfa-4011-9ddc-5d83a2a20121 with Priority: HIGHEST for action security_group_rules [ 631.878340] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f83113a5-bbfa-4011-9ddc-5d83a2a20121 with Priority: HIGHEST for action security_group_rules [ 631.881806] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f83113a5-bbfa-4011-9ddc-5d83a2a20121 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.881930] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f83113a5-bbfa-4011-9ddc-5d83a2a20121" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.883524] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f83113a5-bbfa-4011-9ddc-5d83a2a20121" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.883815] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f83113a5-bbfa-4011-9ddc-5d83a2a20121" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.883902] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f83113a5-bbfa-4011-9ddc-5d83a2a20121',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.907297] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.909117] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.909117] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.909117] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.909117] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.917037] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a93825c-656b-4f3f-b946-3346edd746bf in Status: UNINITIALIZED for 2s [ 632.061729] env[70764]: INFO networking_nsxv3.common.synchronization [None req-29fca0f1-7beb-4390-aa36-11817cd35a5b tempest-VolumesAssistedSnapshotsTest-491546016 tempest-VolumesAssistedSnapshotsTest-491546016-project-member] Enqueued Resource ID: f83113a5-bbfa-4011-9ddc-5d83a2a20121 with Priority: HIGHEST for action security_group_rules [ 632.061729] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f83113a5-bbfa-4011-9ddc-5d83a2a20121 with Priority: HIGHEST for action security_group_rules [ 632.061729] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f83113a5-bbfa-4011-9ddc-5d83a2a20121 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.061729] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f83113a5-bbfa-4011-9ddc-5d83a2a20121" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.111786] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d7651b0e-7703-42a8-bc1c-48c06ccd6ccf [ 632.111786] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.111786] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.111786] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.111786] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.111786] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.111786] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d7651b0e-7703-42a8-bc1c-48c06ccd6ccf already deleted. [ 632.111786] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7651b0e-7703-42a8-bc1c-48c06ccd6ccf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.405801] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.405989] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.406743] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.407441] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.407441] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.407603] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f83113a5-bbfa-4011-9ddc-5d83a2a20121 already deleted. [ 632.408285] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f83113a5-bbfa-4011-9ddc-5d83a2a20121" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.408285] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f83113a5-bbfa-4011-9ddc-5d83a2a20121" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.408567] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f83113a5-bbfa-4011-9ddc-5d83a2a20121" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.408622] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f83113a5-bbfa-4011-9ddc-5d83a2a20121',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.507505] env[70764]: INFO networking_nsxv3.common.synchronization [req-81b9e177-359f-41ba-93b7-28554ce58817 req-802b3ea7-4c31-4d3b-b730-4b6c88e3e945 service nova] Enqueued Resource ID: 053f53ee-d0a4-4067-829d-5dc886808f18 with Priority: HIGHEST for action security_group_rules [ 632.507719] env[70764]: INFO networking_nsxv3.common.synchronization [req-81b9e177-359f-41ba-93b7-28554ce58817 req-802b3ea7-4c31-4d3b-b730-4b6c88e3e945 service nova] Enqueued Resource ID: 053f53ee-d0a4-4067-829d-5dc886808f18 with Priority: HIGHEST for action security_group_members [ 632.507923] env[70764]: INFO networking_nsxv3.common.synchronization [req-81b9e177-359f-41ba-93b7-28554ce58817 req-802b3ea7-4c31-4d3b-b730-4b6c88e3e945 service nova] Enqueued Resource ID: aa39baa7-bf4f-413d-bc00-3021fcfda607 with Priority: HIGHEST for action port [ 632.508889] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 053f53ee-d0a4-4067-829d-5dc886808f18 with Priority: HIGHEST for action security_group_rules [ 632.508889] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 053f53ee-d0a4-4067-829d-5dc886808f18 with Priority: HIGHEST for action security_group_members [ 632.508889] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa39baa7-bf4f-413d-bc00-3021fcfda607 with Priority: HIGHEST for action port [ 632.508889] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-053f53ee-d0a4-4067-829d-5dc886808f18 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.509170] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.510513] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.511119] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.511362] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('053f53ee-d0a4-4067-829d-5dc886808f18',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.513287] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-053f53ee-d0a4-4067-829d-5dc886808f18 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.513391] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.513474] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.513694] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.513966] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.514100] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.516243] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.516243] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.516243] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.516243] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('053f53ee-d0a4-4067-829d-5dc886808f18',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.517272] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa39baa7-bf4f-413d-bc00-3021fcfda607 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.520447] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa39baa7-bf4f-413d-bc00-3021fcfda607" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.520447] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa39baa7-bf4f-413d-bc00-3021fcfda607" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.520447] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa39baa7-bf4f-413d-bc00-3021fcfda607" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.520447] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa39baa7-bf4f-413d-bc00-3021fcfda607',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.634231] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-343 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.634231] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-343" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.634231] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-343" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.634231] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-343" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.634231] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.634231] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.634231] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.634231] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.634231] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.634231] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 632.635540] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 632.635756] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 632.635953] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 632.636149] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 632.636317] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 632.636514] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 632.655306] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 632.655470] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 632.655600] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 632.655780] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-343" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.656103] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-e4316998-1865-45ce-bdc2-d91cfe5ae09f taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.656271] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-e4316998-1865-45ce-bdc2-d91cfe5ae09f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.656385] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-e4316998-1865-45ce-bdc2-d91cfe5ae09f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.656730] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-e4316998-1865-45ce-bdc2-d91cfe5ae09f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.656861] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4316998-1865-45ce-bdc2-d91cfe5ae09f',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.935350] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.935350] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.935350] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.935350] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.935350] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.935350] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f83113a5-bbfa-4011-9ddc-5d83a2a20121 already deleted. [ 632.935350] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f83113a5-bbfa-4011-9ddc-5d83a2a20121" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.015288] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-053f53ee-d0a4-4067-829d-5dc886808f18 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.015415] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.018325] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('053f53ee-d0a4-4067-829d-5dc886808f18',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.021057] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aa39baa7-bf4f-413d-bc00-3021fcfda607 with status ACTIVE [ 633.021260] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.021380] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.021445] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.021643] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.021724] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.021904] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.021997] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.022225] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.022225] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.022322] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.022462] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.022648] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.022648] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.024527] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.024527] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.024527] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aa39baa7-bf4f-413d-bc00-3021fcfda607 is going to be updated. [ 633.043284] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.043284] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.043284] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.043284] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.043284] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.043284] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa39baa7-bf4f-413d-bc00-3021fcfda607" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.159655] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.159910] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.159972] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.160222] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.160367] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.160521] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port e4316998-1865-45ce-bdc2-d91cfe5ae09f not found, creating... [ 633.161038] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.161038] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.161038] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.161661] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.161661] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.161661] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.161816] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.161914] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.162134] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.162270] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.162407] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: e4316998-1865-45ce-bdc2-d91cfe5ae09f is going to be created. [ 633.184043] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.184255] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.184377] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.184641] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.184869] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.185099] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-e4316998-1865-45ce-bdc2-d91cfe5ae09f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.217779] env[70764]: INFO networking_nsxv3.common.synchronization [None req-728b1eac-7e6f-45e8-a5e2-6e09e3dbdbac None None] Enqueued Resource ID: e236e211-5b6c-4ceb-96ae-f782f50304f4 with Priority: HIGHEST for action port [ 633.218063] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e236e211-5b6c-4ceb-96ae-f782f50304f4 with Priority: HIGHEST for action port [ 633.218602] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-e236e211-5b6c-4ceb-96ae-f782f50304f4 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.218708] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e236e211-5b6c-4ceb-96ae-f782f50304f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.218831] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e236e211-5b6c-4ceb-96ae-f782f50304f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.222389] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e236e211-5b6c-4ceb-96ae-f782f50304f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.222720] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e236e211-5b6c-4ceb-96ae-f782f50304f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.522764] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('053f53ee-d0a4-4067-829d-5dc886808f18',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.725522] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e236e211-5b6c-4ceb-96ae-f782f50304f4 [ 633.725522] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.725522] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.725646] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.725805] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.725894] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.725994] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e236e211-5b6c-4ceb-96ae-f782f50304f4 already deleted. [ 633.726088] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e236e211-5b6c-4ceb-96ae-f782f50304f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.891543] env[70764]: INFO networking_nsxv3.common.synchronization [None req-ab756fad-f1cb-4949-88a9-52d314818740 None None] Enqueued Resource ID: d440b34b-8aff-49c2-bc6d-473b9d23f3cf with Priority: HIGHEST for action port [ 633.891543] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d440b34b-8aff-49c2-bc6d-473b9d23f3cf with Priority: HIGHEST for action port [ 633.891543] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-d440b34b-8aff-49c2-bc6d-473b9d23f3cf taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.891816] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d440b34b-8aff-49c2-bc6d-473b9d23f3cf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.891816] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d440b34b-8aff-49c2-bc6d-473b9d23f3cf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.891925] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d440b34b-8aff-49c2-bc6d-473b9d23f3cf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.892363] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d440b34b-8aff-49c2-bc6d-473b9d23f3cf',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.928084] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a93825c-656b-4f3f-b946-3346edd746bf in Status: SUCCESS [ 633.928084] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.928084] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.928084] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.928084] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.928084] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.928084] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.928084] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.928084] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.928084] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.928084] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2a93825c-656b-4f3f-b946-3346edd746bf',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.028537] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.031188] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.031188] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.031188] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.031188] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.031188] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 053f53ee-d0a4-4067-829d-5dc886808f18 is going to be created. [ 634.055258] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.056785] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.056785] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.056785] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.056785] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.066584] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 053f53ee-d0a4-4067-829d-5dc886808f18 in Status: UNINITIALIZED for 2s [ 634.399393] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d440b34b-8aff-49c2-bc6d-473b9d23f3cf [ 634.399651] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.399800] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.399892] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.400117] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.400204] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.400394] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d440b34b-8aff-49c2-bc6d-473b9d23f3cf already deleted. [ 634.400394] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d440b34b-8aff-49c2-bc6d-473b9d23f3cf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.401400] env[70764]: INFO networking_nsxv3.common.synchronization [req-91477307-bc72-4225-ae8d-62c9b73f6b87 req-d9215a3a-095b-4dae-9200-4e73635400a1 service nova] Enqueued Resource ID: 8e62e528-352b-40bb-8f9d-c7bb50b75dff with Priority: HIGHEST for action security_group_rules [ 634.401451] env[70764]: INFO networking_nsxv3.common.synchronization [req-91477307-bc72-4225-ae8d-62c9b73f6b87 req-d9215a3a-095b-4dae-9200-4e73635400a1 service nova] Enqueued Resource ID: 8e62e528-352b-40bb-8f9d-c7bb50b75dff with Priority: HIGHEST for action security_group_members [ 634.402014] env[70764]: INFO networking_nsxv3.common.synchronization [req-91477307-bc72-4225-ae8d-62c9b73f6b87 req-d9215a3a-095b-4dae-9200-4e73635400a1 service nova] Enqueued Resource ID: e4316998-1865-45ce-bdc2-d91cfe5ae09f with Priority: HIGHEST for action port [ 634.404155] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e62e528-352b-40bb-8f9d-c7bb50b75dff with Priority: HIGHEST for action security_group_rules [ 634.405315] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e62e528-352b-40bb-8f9d-c7bb50b75dff with Priority: HIGHEST for action security_group_members [ 634.405315] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4316998-1865-45ce-bdc2-d91cfe5ae09f with Priority: HIGHEST for action port [ 634.405315] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e62e528-352b-40bb-8f9d-c7bb50b75dff taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.405315] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e62e528-352b-40bb-8f9d-c7bb50b75dff" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.405622] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e62e528-352b-40bb-8f9d-c7bb50b75dff" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.405653] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e62e528-352b-40bb-8f9d-c7bb50b75dff" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.406039] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e62e528-352b-40bb-8f9d-c7bb50b75dff',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.406627] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e62e528-352b-40bb-8f9d-c7bb50b75dff taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.406736] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e62e528-352b-40bb-8f9d-c7bb50b75dff" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.406801] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e62e528-352b-40bb-8f9d-c7bb50b75dff" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.406988] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e62e528-352b-40bb-8f9d-c7bb50b75dff" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.407383] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.407467] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.407501] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.408168] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.408168] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.408168] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e62e528-352b-40bb-8f9d-c7bb50b75dff',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.408638] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-e4316998-1865-45ce-bdc2-d91cfe5ae09f taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.408808] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e4316998-1865-45ce-bdc2-d91cfe5ae09f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.408808] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e4316998-1865-45ce-bdc2-d91cfe5ae09f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.408993] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e4316998-1865-45ce-bdc2-d91cfe5ae09f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.409098] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4316998-1865-45ce-bdc2-d91cfe5ae09f',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.432844] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a93825c-656b-4f3f-b946-3346edd746bf taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.433820] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.433820] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.433820] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.433820] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.433820] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.433820] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.439352] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.439352] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.439352] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.439352] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a93825c-656b-4f3f-b946-3346edd746bf taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.439352] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.439352] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.439352] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.439352] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.439352] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.439352] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.439352] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.439352] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.439352] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.439352] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2a93825c-656b-4f3f-b946-3346edd746bf',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.910619] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e62e528-352b-40bb-8f9d-c7bb50b75dff taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.910835] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e62e528-352b-40bb-8f9d-c7bb50b75dff" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.911238] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8e62e528-352b-40bb-8f9d-c7bb50b75dff',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.912303] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e4316998-1865-45ce-bdc2-d91cfe5ae09f with status ACTIVE [ 634.912533] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.912730] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.912856] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.912951] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.913082] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.913379] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.913379] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.913512] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.913614] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.913695] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.913900] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.913996] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.914070] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.914212] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.914288] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.914375] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e4316998-1865-45ce-bdc2-d91cfe5ae09f is going to be updated. [ 634.937886] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.938023] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.938023] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.938324] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.938489] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.938674] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e4316998-1865-45ce-bdc2-d91cfe5ae09f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.943728] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2a93825c-656b-4f3f-b946-3346edd746bf: rpc.has_security_group_logging(os_id): False [ 634.959421] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.959574] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.959667] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.959894] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.960094] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.960185] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.960287] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.960365] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.960515] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.960589] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.960777] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.960866] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.960939] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.961076] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.961147] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.962153] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.962153] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.962153] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.962153] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.962153] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.962153] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a93825c-656b-4f3f-b946-3346edd746bf is going to be created. [ 635.030204] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.030543] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.030543] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.030820] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.030894] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.049166] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a93825c-656b-4f3f-b946-3346edd746bf in Status: IN_PROGRESS for 2s [ 635.418123] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8e62e528-352b-40bb-8f9d-c7bb50b75dff',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.659838] env[70764]: INFO networking_nsxv3.common.synchronization [None req-c74affd0-554c-4cd9-8702-fa92e2be6b73 None None] Enqueued Resource ID: 6de89ea7-ff56-4ecf-b2b7-aae085a4bf55 with Priority: HIGHEST for action port [ 635.660362] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6de89ea7-ff56-4ecf-b2b7-aae085a4bf55 with Priority: HIGHEST for action port [ 635.660904] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-6de89ea7-ff56-4ecf-b2b7-aae085a4bf55 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.661310] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6de89ea7-ff56-4ecf-b2b7-aae085a4bf55" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.661506] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6de89ea7-ff56-4ecf-b2b7-aae085a4bf55" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.661656] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6de89ea7-ff56-4ecf-b2b7-aae085a4bf55" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.661741] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6de89ea7-ff56-4ecf-b2b7-aae085a4bf55',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.922501] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.922501] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.922501] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.922501] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.922501] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.922501] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e62e528-352b-40bb-8f9d-c7bb50b75dff is going to be created. [ 635.946574] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.946574] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.946574] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.946574] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.946574] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.955083] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e62e528-352b-40bb-8f9d-c7bb50b75dff in Status: UNINITIALIZED for 2s [ 636.076923] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 053f53ee-d0a4-4067-829d-5dc886808f18 in Status: SUCCESS [ 636.077289] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.077369] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.077679] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.077873] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.078016] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.078112] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.078247] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.078433] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.078433] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.078515] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('053f53ee-d0a4-4067-829d-5dc886808f18',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.167656] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6de89ea7-ff56-4ecf-b2b7-aae085a4bf55 [ 636.167656] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.167656] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.167656] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.167656] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.167850] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.167950] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6de89ea7-ff56-4ecf-b2b7-aae085a4bf55 already deleted. [ 636.168043] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6de89ea7-ff56-4ecf-b2b7-aae085a4bf55" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.583348] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-053f53ee-d0a4-4067-829d-5dc886808f18 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.585253] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.585425] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.585718] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.586419] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.586607] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.586607] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.586783] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.586963] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.587065] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.588784] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-053f53ee-d0a4-4067-829d-5dc886808f18 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.588784] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.588784] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.588784] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.588784] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.588784] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.588784] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.588784] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.588784] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.589178] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.589178] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('053f53ee-d0a4-4067-829d-5dc886808f18',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.999827] env[70764]: INFO networking_nsxv3.common.synchronization [req-d9b259f3-69ec-4de1-836d-0b9327f464b1 req-c7260b18-2371-4fca-b55d-c725528919bf tempest-ServerExternalEventsTest-779949483 tempest-ServerExternalEventsTest-779949483-project-member] Enqueued Resource ID: 4bfe698a-a7e8-4922-85ee-f21b719b7edb with Priority: HIGHEST for action security_group_members [ 637.000878] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bfe698a-a7e8-4922-85ee-f21b719b7edb with Priority: HIGHEST for action security_group_members [ 637.000878] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bfe698a-a7e8-4922-85ee-f21b719b7edb taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.000878] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bfe698a-a7e8-4922-85ee-f21b719b7edb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.000878] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bfe698a-a7e8-4922-85ee-f21b719b7edb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.001335] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bfe698a-a7e8-4922-85ee-f21b719b7edb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.001511] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.001614] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.001671] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.001834] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.001921] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.002019] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4bfe698a-a7e8-4922-85ee-f21b719b7edb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.062665] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a93825c-656b-4f3f-b946-3346edd746bf in Status: SUCCESS [ 637.063049] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.092516] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 053f53ee-d0a4-4067-829d-5dc886808f18: rpc.has_security_group_logging(os_id): False [ 637.110097] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.110382] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.110456] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.110697] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.110796] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.110977] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.111131] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.111216] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.111374] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.111466] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.111657] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.111753] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.111813] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.111950] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.112408] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.112677] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.112844] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.112914] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.113075] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.113155] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.113269] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 053f53ee-d0a4-4067-829d-5dc886808f18 is going to be created. [ 637.167185] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.167185] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.167185] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.167185] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.167376] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.179785] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 053f53ee-d0a4-4067-829d-5dc886808f18 in Status: IN_PROGRESS for 2s [ 637.203282] env[70764]: INFO networking_nsxv3.common.synchronization [req-62d56c80-29e2-405d-8b77-4e72e4e12387 req-b768458f-f453-4018-a0a4-d8b5c5fb62d5 tempest-SecurityGroupRulesTestJSON-86292721 tempest-SecurityGroupRulesTestJSON-86292721-project-member] Enqueued Resource ID: cd4ced8c-25c7-418b-a28c-8b38a741cf21 with Priority: HIGHEST for action security_group_rules [ 637.203841] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd4ced8c-25c7-418b-a28c-8b38a741cf21 with Priority: HIGHEST for action security_group_rules [ 637.204817] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd4ced8c-25c7-418b-a28c-8b38a741cf21 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.204920] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd4ced8c-25c7-418b-a28c-8b38a741cf21" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.204984] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd4ced8c-25c7-418b-a28c-8b38a741cf21" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.205213] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd4ced8c-25c7-418b-a28c-8b38a741cf21" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.205464] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd4ced8c-25c7-418b-a28c-8b38a741cf21',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.506077] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.506240] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.506240] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.506494] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.506646] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.506851] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.506905] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.506958] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.507133] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.507208] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.507507] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bfe698a-a7e8-4922-85ee-f21b719b7edb already deleted. [ 637.507507] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bfe698a-a7e8-4922-85ee-f21b719b7edb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.724169] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.724322] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.724412] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.724594] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.724679] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.724858] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd4ced8c-25c7-418b-a28c-8b38a741cf21 already deleted. [ 637.724951] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd4ced8c-25c7-418b-a28c-8b38a741cf21" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.967575] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e62e528-352b-40bb-8f9d-c7bb50b75dff in Status: SUCCESS [ 637.967862] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e62e528-352b-40bb-8f9d-c7bb50b75dff" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.968069] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e62e528-352b-40bb-8f9d-c7bb50b75dff" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.968286] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e62e528-352b-40bb-8f9d-c7bb50b75dff" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.968578] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.968671] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.968671] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.968870] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.970855] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.971086] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e62e528-352b-40bb-8f9d-c7bb50b75dff" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.971219] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8e62e528-352b-40bb-8f9d-c7bb50b75dff',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.041417] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-343 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.041997] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-343" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.042883] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-343" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.042982] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-343" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.043661] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.043661] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.043825] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.044467] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.044467] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.044657] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 638.045050] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 638.045522] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 638.045522] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 638.045522] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 638.045522] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 638.046201] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 638.067338] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 638.067447] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 638.067593] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 638.067773] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-343" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.068112] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-ffb092e4-c4dd-434d-b93e-c6739d866af5 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.068299] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-ffb092e4-c4dd-434d-b93e-c6739d866af5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.068473] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-ffb092e4-c4dd-434d-b93e-c6739d866af5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.069348] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-ffb092e4-c4dd-434d-b93e-c6739d866af5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.069348] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffb092e4-c4dd-434d-b93e-c6739d866af5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.119932] env[70764]: INFO networking_nsxv3.common.synchronization [None req-ca1c5ef3-4fa4-4650-a104-9a9d4a536f04 None None] Enqueued Resource ID: 16c06745-ed42-4fb6-b2e6-112928337ea3 with Priority: HIGHEST for action port [ 638.120908] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16c06745-ed42-4fb6-b2e6-112928337ea3 with Priority: HIGHEST for action port [ 638.124976] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-16c06745-ed42-4fb6-b2e6-112928337ea3 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.125539] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16c06745-ed42-4fb6-b2e6-112928337ea3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.125539] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16c06745-ed42-4fb6-b2e6-112928337ea3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.125539] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16c06745-ed42-4fb6-b2e6-112928337ea3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.125697] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16c06745-ed42-4fb6-b2e6-112928337ea3',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.427596] env[70764]: INFO networking_nsxv3.common.synchronization [req-751574cc-98ae-452c-b5a9-376ed71aa37f req-27f4252f-e8db-4555-85f3-ddb860fc0cbd tempest-SecurityGroupsTestJSON-512195178 tempest-SecurityGroupsTestJSON-512195178-project-member] Enqueued Resource ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b with Priority: HIGHEST for action security_group_members [ 638.428932] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b with Priority: HIGHEST for action security_group_members [ 638.429257] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.429379] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.429447] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.429697] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.429849] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.430054] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.430312] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.430537] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.430605] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.430670] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.474089] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e62e528-352b-40bb-8f9d-c7bb50b75dff taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.474210] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e62e528-352b-40bb-8f9d-c7bb50b75dff" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.474280] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e62e528-352b-40bb-8f9d-c7bb50b75dff" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.474498] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e62e528-352b-40bb-8f9d-c7bb50b75dff" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.474666] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.474771] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.474835] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.474981] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.475083] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.475173] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e62e528-352b-40bb-8f9d-c7bb50b75dff" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.475322] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e62e528-352b-40bb-8f9d-c7bb50b75dff taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.475412] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e62e528-352b-40bb-8f9d-c7bb50b75dff" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.475518] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e62e528-352b-40bb-8f9d-c7bb50b75dff" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.475606] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e62e528-352b-40bb-8f9d-c7bb50b75dff" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.475747] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.475856] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.475856] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.475856] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.475856] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.475856] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e62e528-352b-40bb-8f9d-c7bb50b75dff" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.475856] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8e62e528-352b-40bb-8f9d-c7bb50b75dff',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.572515] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.572515] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.572515] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.572726] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.573824] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.573824] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port ffb092e4-c4dd-434d-b93e-c6739d866af5 not found, creating... [ 638.573824] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.573824] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.573824] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.573824] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.573824] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.574132] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.574700] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.574700] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.574700] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.575067] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.575432] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: ffb092e4-c4dd-434d-b93e-c6739d866af5 is going to be created. [ 638.598314] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.598314] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.598314] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.598314] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.598314] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.598314] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-ffb092e4-c4dd-434d-b93e-c6739d866af5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.630314] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 16c06745-ed42-4fb6-b2e6-112928337ea3 [ 638.630557] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.630777] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.630887] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.631074] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.631164] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.631256] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:16c06745-ed42-4fb6-b2e6-112928337ea3 already deleted. [ 638.631337] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16c06745-ed42-4fb6-b2e6-112928337ea3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.933102] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.933102] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.933102] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.933677] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.933785] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.934010] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.934470] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.934569] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.934745] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.934850] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.934943] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b already deleted. [ 638.935037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.979222] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8e62e528-352b-40bb-8f9d-c7bb50b75dff: rpc.has_security_group_logging(os_id): False [ 638.996204] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.996364] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.996424] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.996669] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.996775] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.996998] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.997113] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.997175] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.997408] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.997408] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.997566] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.997661] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.997721] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.997858] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.997929] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.998149] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.998248] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.998308] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.998449] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.998521] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.998605] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e62e528-352b-40bb-8f9d-c7bb50b75dff is going to be created. [ 639.051853] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.052092] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.052140] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.052414] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.052552] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.064139] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e62e528-352b-40bb-8f9d-c7bb50b75dff in Status: IN_PROGRESS for 2s [ 639.067460] env[70764]: INFO networking_nsxv3.common.synchronization [None req-1f41b65b-68df-439f-8011-a9dedd7448af None None] Enqueued Resource ID: c581d514-1dd8-4937-b74b-fa0b0af2018f with Priority: HIGHEST for action port [ 639.067552] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c581d514-1dd8-4937-b74b-fa0b0af2018f with Priority: HIGHEST for action port [ 639.068699] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-c581d514-1dd8-4937-b74b-fa0b0af2018f taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.068699] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c581d514-1dd8-4937-b74b-fa0b0af2018f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.068699] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c581d514-1dd8-4937-b74b-fa0b0af2018f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.068699] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c581d514-1dd8-4937-b74b-fa0b0af2018f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.068699] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c581d514-1dd8-4937-b74b-fa0b0af2018f',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.194430] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 053f53ee-d0a4-4067-829d-5dc886808f18 in Status: SUCCESS [ 639.194430] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.571644] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c581d514-1dd8-4937-b74b-fa0b0af2018f [ 639.571644] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.571770] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.571770] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.572355] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.572355] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.572355] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c581d514-1dd8-4937-b74b-fa0b0af2018f already deleted. [ 639.572355] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c581d514-1dd8-4937-b74b-fa0b0af2018f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.993043] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-87 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.993234] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-87" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.993333] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-87" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.993615] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-87" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.993865] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.994035] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.994154] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.994443] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.994512] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.995151] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 639.995151] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 639.995151] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 639.995151] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 639.995151] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 639.995355] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 639.995355] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 640.012541] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 640.012708] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 640.012852] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 640.013040] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-87" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.013375] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-c2694d3f-527f-4890-bf9d-62a74f11b251 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.013553] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-c2694d3f-527f-4890-bf9d-62a74f11b251" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.013672] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-c2694d3f-527f-4890-bf9d-62a74f11b251" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.014142] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-c2694d3f-527f-4890-bf9d-62a74f11b251" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.014142] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2694d3f-527f-4890-bf9d-62a74f11b251',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.399671] env[70764]: INFO networking_nsxv3.common.synchronization [req-d9b259f3-69ec-4de1-836d-0b9327f464b1 req-45b4f661-6319-4a2e-8316-57fec9a511de service nova] Enqueued Resource ID: 4bfe698a-a7e8-4922-85ee-f21b719b7edb with Priority: HIGHEST for action security_group_rules [ 640.399997] env[70764]: INFO networking_nsxv3.common.synchronization [req-d9b259f3-69ec-4de1-836d-0b9327f464b1 req-45b4f661-6319-4a2e-8316-57fec9a511de service nova] Enqueued Resource ID: 4bfe698a-a7e8-4922-85ee-f21b719b7edb with Priority: HIGHEST for action security_group_members [ 640.400158] env[70764]: INFO networking_nsxv3.common.synchronization [req-d9b259f3-69ec-4de1-836d-0b9327f464b1 req-45b4f661-6319-4a2e-8316-57fec9a511de service nova] Enqueued Resource ID: ffb092e4-c4dd-434d-b93e-c6739d866af5 with Priority: HIGHEST for action port [ 640.400347] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bfe698a-a7e8-4922-85ee-f21b719b7edb with Priority: HIGHEST for action security_group_rules [ 640.400474] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bfe698a-a7e8-4922-85ee-f21b719b7edb with Priority: HIGHEST for action security_group_members [ 640.400567] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffb092e4-c4dd-434d-b93e-c6739d866af5 with Priority: HIGHEST for action port [ 640.401763] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4bfe698a-a7e8-4922-85ee-f21b719b7edb taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.402010] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4bfe698a-a7e8-4922-85ee-f21b719b7edb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.403276] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4bfe698a-a7e8-4922-85ee-f21b719b7edb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.403578] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4bfe698a-a7e8-4922-85ee-f21b719b7edb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.404208] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4bfe698a-a7e8-4922-85ee-f21b719b7edb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.404704] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bfe698a-a7e8-4922-85ee-f21b719b7edb taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.405051] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bfe698a-a7e8-4922-85ee-f21b719b7edb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.405051] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bfe698a-a7e8-4922-85ee-f21b719b7edb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.405267] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bfe698a-a7e8-4922-85ee-f21b719b7edb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.405765] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.405765] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.405765] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.405765] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.406051] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.406051] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4bfe698a-a7e8-4922-85ee-f21b719b7edb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.407055] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-ffb092e4-c4dd-434d-b93e-c6739d866af5 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.407247] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ffb092e4-c4dd-434d-b93e-c6739d866af5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.408769] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ffb092e4-c4dd-434d-b93e-c6739d866af5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.408769] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ffb092e4-c4dd-434d-b93e-c6739d866af5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.408769] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffb092e4-c4dd-434d-b93e-c6739d866af5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.497064] env[70764]: INFO networking_nsxv3.common.synchronization [None req-f618393b-8994-42c7-93e3-dbf99fd3badd None None] Enqueued Resource ID: 0eafbc9b-31f5-4b3f-91cc-bb36b34b5fca with Priority: HIGHEST for action port [ 640.497317] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0eafbc9b-31f5-4b3f-91cc-bb36b34b5fca with Priority: HIGHEST for action port [ 640.497857] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-0eafbc9b-31f5-4b3f-91cc-bb36b34b5fca taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.498994] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0eafbc9b-31f5-4b3f-91cc-bb36b34b5fca" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.499048] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0eafbc9b-31f5-4b3f-91cc-bb36b34b5fca" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.499285] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0eafbc9b-31f5-4b3f-91cc-bb36b34b5fca" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.499365] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0eafbc9b-31f5-4b3f-91cc-bb36b34b5fca',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.517158] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.517923] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.518241] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.518599] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.518820] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.519044] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port c2694d3f-527f-4890-bf9d-62a74f11b251 not found, creating... [ 640.519444] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.519949] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.520254] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.520558] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.521174] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.521174] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.521336] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.521506] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.521776] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.521968] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.522179] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: c2694d3f-527f-4890-bf9d-62a74f11b251 is going to be created. [ 640.544203] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.544536] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.544698] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.545032] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.545310] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.546213] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-c2694d3f-527f-4890-bf9d-62a74f11b251" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.910123] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bfe698a-a7e8-4922-85ee-f21b719b7edb taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.910123] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bfe698a-a7e8-4922-85ee-f21b719b7edb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.910765] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4bfe698a-a7e8-4922-85ee-f21b719b7edb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.912403] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ffb092e4-c4dd-434d-b93e-c6739d866af5 with status ACTIVE [ 640.912658] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.912791] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.912880] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.913108] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.913202] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.913401] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.913507] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.913569] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.913739] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.913818] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.914456] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.914456] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.914456] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.915342] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.915342] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.915342] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ffb092e4-c4dd-434d-b93e-c6739d866af5 is going to be updated. [ 640.939664] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.939664] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.939664] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.939885] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.939922] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.940104] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ffb092e4-c4dd-434d-b93e-c6739d866af5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.002509] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0eafbc9b-31f5-4b3f-91cc-bb36b34b5fca [ 641.002803] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.002980] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.003085] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.003332] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.003456] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.003575] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0eafbc9b-31f5-4b3f-91cc-bb36b34b5fca already deleted. [ 641.006209] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0eafbc9b-31f5-4b3f-91cc-bb36b34b5fca" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.076543] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e62e528-352b-40bb-8f9d-c7bb50b75dff in Status: SUCCESS [ 641.076765] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e62e528-352b-40bb-8f9d-c7bb50b75dff" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.298805] env[70764]: INFO networking_nsxv3.common.synchronization [None req-015da142-9337-43dd-8a74-abbf20c23a82 tempest-ServersWithSpecificFlavorTestJSON-440557435 tempest-ServersWithSpecificFlavorTestJSON-440557435-project-member] Enqueued Resource ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 with Priority: HIGHEST for action security_group_rules [ 641.299497] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 with Priority: HIGHEST for action security_group_rules [ 641.299980] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-380030c5-e260-46fb-aa7e-5000c5bc9507 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.299980] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.300143] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.302768] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.304029] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('380030c5-e260-46fb-aa7e-5000c5bc9507',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.383764] env[70764]: INFO networking_nsxv3.common.synchronization [None req-d892f0e0-2a57-4a59-9de3-b4ac9d5f3172 None None] Enqueued Resource ID: 67a7f5c3-1ac9-435f-9fb1-d51ff5362010 with Priority: HIGHEST for action port [ 641.384310] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67a7f5c3-1ac9-435f-9fb1-d51ff5362010 with Priority: HIGHEST for action port [ 641.384611] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-67a7f5c3-1ac9-435f-9fb1-d51ff5362010 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.384725] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-67a7f5c3-1ac9-435f-9fb1-d51ff5362010" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.384792] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-67a7f5c3-1ac9-435f-9fb1-d51ff5362010" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.386702] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-67a7f5c3-1ac9-435f-9fb1-d51ff5362010" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.386702] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67a7f5c3-1ac9-435f-9fb1-d51ff5362010',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.417151] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4bfe698a-a7e8-4922-85ee-f21b719b7edb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.430737] env[70764]: INFO networking_nsxv3.common.synchronization [None req-4b835c1f-9445-42f2-b67d-ff4ea5570d0b None None] Enqueued Resource ID: f4656fbb-bd2e-45f3-8842-0b65cca7872a with Priority: HIGHEST for action port [ 641.431263] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4656fbb-bd2e-45f3-8842-0b65cca7872a with Priority: HIGHEST for action port [ 641.431582] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4656fbb-bd2e-45f3-8842-0b65cca7872a taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.431707] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4656fbb-bd2e-45f3-8842-0b65cca7872a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.431775] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4656fbb-bd2e-45f3-8842-0b65cca7872a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.433968] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4656fbb-bd2e-45f3-8842-0b65cca7872a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.434315] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4656fbb-bd2e-45f3-8842-0b65cca7872a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.636273] env[70764]: INFO networking_nsxv3.common.synchronization [None req-456f13b9-e9ad-4c34-bfb0-4f908468c176 tempest-ServersWithSpecificFlavorTestJSON-440557435 tempest-ServersWithSpecificFlavorTestJSON-440557435-project-member] Enqueued Resource ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 with Priority: HIGHEST for action security_group_rules [ 641.636816] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 with Priority: HIGHEST for action security_group_rules [ 641.641564] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-380030c5-e260-46fb-aa7e-5000c5bc9507 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.641564] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.823370] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.823539] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.823607] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.824210] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.824210] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.824210] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 already deleted. [ 641.824210] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.824430] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.824430] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.824484] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('380030c5-e260-46fb-aa7e-5000c5bc9507',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.888339] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 67a7f5c3-1ac9-435f-9fb1-d51ff5362010 [ 641.888339] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.888339] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.888339] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.888682] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.888682] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.888800] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:67a7f5c3-1ac9-435f-9fb1-d51ff5362010 already deleted. [ 641.888847] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-67a7f5c3-1ac9-435f-9fb1-d51ff5362010" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.920467] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.920677] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.921040] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.921040] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.921183] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.921183] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bfe698a-a7e8-4922-85ee-f21b719b7edb is going to be created. [ 641.941575] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f4656fbb-bd2e-45f3-8842-0b65cca7872a [ 641.941575] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.941575] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.941575] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.941575] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.941575] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.941575] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f4656fbb-bd2e-45f3-8842-0b65cca7872a already deleted. [ 641.941575] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4656fbb-bd2e-45f3-8842-0b65cca7872a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.945625] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.945839] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.945839] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.947199] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.947199] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.960021] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bfe698a-a7e8-4922-85ee-f21b719b7edb in Status: UNINITIALIZED for 2s [ 642.051285] env[70764]: INFO networking_nsxv3.common.synchronization [None req-5726e081-0c1b-47b3-9b7f-709ebb6d1c72 None None] Enqueued Resource ID: 2d4ed203-8611-429e-baa1-754827815f57 with Priority: HIGHEST for action port [ 642.051285] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d4ed203-8611-429e-baa1-754827815f57 with Priority: HIGHEST for action port [ 642.051285] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d4ed203-8611-429e-baa1-754827815f57 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.051285] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d4ed203-8611-429e-baa1-754827815f57" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.051795] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d4ed203-8611-429e-baa1-754827815f57" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.052283] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d4ed203-8611-429e-baa1-754827815f57" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.052283] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d4ed203-8611-429e-baa1-754827815f57',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.344705] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.344705] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.344705] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.345403] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.345403] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.345507] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 already deleted. [ 642.345575] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.521182] env[70764]: INFO networking_nsxv3.common.synchronization [req-751574cc-98ae-452c-b5a9-376ed71aa37f req-f1901baf-6e6b-4613-b3ef-a47154bddfab service nova] Enqueued Resource ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b with Priority: HIGHEST for action security_group_rules [ 642.521182] env[70764]: INFO networking_nsxv3.common.synchronization [req-751574cc-98ae-452c-b5a9-376ed71aa37f req-f1901baf-6e6b-4613-b3ef-a47154bddfab service nova] Enqueued Resource ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b with Priority: HIGHEST for action security_group_members [ 642.521182] env[70764]: INFO networking_nsxv3.common.synchronization [req-751574cc-98ae-452c-b5a9-376ed71aa37f req-f1901baf-6e6b-4613-b3ef-a47154bddfab service nova] Enqueued Resource ID: c2694d3f-527f-4890-bf9d-62a74f11b251 with Priority: HIGHEST for action port [ 642.521503] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b with Priority: HIGHEST for action security_group_rules [ 642.521503] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b with Priority: HIGHEST for action security_group_members [ 642.521612] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2694d3f-527f-4890-bf9d-62a74f11b251 with Priority: HIGHEST for action port [ 642.521801] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c2d79e00-b6b0-41f3-96fb-49ab2b10751b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.521917] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.521980] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.522238] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.522315] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.523251] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.523428] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.523489] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.523662] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.523806] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.523899] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.523958] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.524113] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.524193] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.524278] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.525010] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2694d3f-527f-4890-bf9d-62a74f11b251 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.525111] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2694d3f-527f-4890-bf9d-62a74f11b251" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.525173] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2694d3f-527f-4890-bf9d-62a74f11b251" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.525318] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2694d3f-527f-4890-bf9d-62a74f11b251" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.525386] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2694d3f-527f-4890-bf9d-62a74f11b251',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.554090] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2d4ed203-8611-429e-baa1-754827815f57 [ 642.554493] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.554754] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.555119] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.555524] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.555811] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.556017] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2d4ed203-8611-429e-baa1-754827815f57 already deleted. [ 642.556190] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d4ed203-8611-429e-baa1-754827815f57" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.029015] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.029015] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.029015] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.029626] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c2694d3f-527f-4890-bf9d-62a74f11b251 with status ACTIVE [ 643.029843] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.029976] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.030071] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.030275] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.030359] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.030524] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.030616] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.030674] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.030867] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.030949] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.033769] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.033913] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.033989] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.034422] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.034487] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.034580] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c2694d3f-527f-4890-bf9d-62a74f11b251 is going to be updated. [ 643.057320] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.057463] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.057566] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.057742] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.057880] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.058074] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2694d3f-527f-4890-bf9d-62a74f11b251" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.249807] env[70764]: INFO networking_nsxv3.common.synchronization [req-df1cb55b-a468-40c5-869d-02850d4d103c req-14c168f6-fe71-41e3-aeab-897964007a2c tempest-VolumesAssistedSnapshotsTest-491546016 tempest-VolumesAssistedSnapshotsTest-491546016-project-member] Enqueued Resource ID: f83113a5-bbfa-4011-9ddc-5d83a2a20121 with Priority: HIGHEST for action security_group_members [ 643.250198] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f83113a5-bbfa-4011-9ddc-5d83a2a20121 with Priority: HIGHEST for action security_group_members [ 643.250517] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f83113a5-bbfa-4011-9ddc-5d83a2a20121 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.250636] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f83113a5-bbfa-4011-9ddc-5d83a2a20121" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.250778] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f83113a5-bbfa-4011-9ddc-5d83a2a20121" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.251057] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f83113a5-bbfa-4011-9ddc-5d83a2a20121" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.251400] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.251701] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.251701] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.252056] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.252056] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.254088] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f83113a5-bbfa-4011-9ddc-5d83a2a20121',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.539341] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.757856] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.757856] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.757856] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.757856] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.757856] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.757856] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.757856] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.757856] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.757856] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.757856] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.757856] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f83113a5-bbfa-4011-9ddc-5d83a2a20121 already deleted. [ 643.757856] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f83113a5-bbfa-4011-9ddc-5d83a2a20121" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.780936] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-26 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.781947] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-26" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.782268] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-26" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.783411] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-26" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.783493] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.783640] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.784448] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.784448] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.784585] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.784851] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 643.785064] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 643.785232] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 643.785350] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 643.785465] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 643.785572] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 643.785703] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 643.804231] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 643.804231] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 643.804231] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 643.804231] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-26" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.804231] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-aa4d4d4e-60f3-4251-a2e3-95ae4d15e8f2 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.804231] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-aa4d4d4e-60f3-4251-a2e3-95ae4d15e8f2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.804231] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-aa4d4d4e-60f3-4251-a2e3-95ae4d15e8f2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.804231] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-aa4d4d4e-60f3-4251-a2e3-95ae4d15e8f2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.804231] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa4d4d4e-60f3-4251-a2e3-95ae4d15e8f2',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.973048] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bfe698a-a7e8-4922-85ee-f21b719b7edb in Status: SUCCESS [ 643.973148] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bfe698a-a7e8-4922-85ee-f21b719b7edb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.973290] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bfe698a-a7e8-4922-85ee-f21b719b7edb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.973508] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bfe698a-a7e8-4922-85ee-f21b719b7edb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.973707] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.973828] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.973889] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.974104] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.974138] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.974375] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bfe698a-a7e8-4922-85ee-f21b719b7edb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.974375] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4bfe698a-a7e8-4922-85ee-f21b719b7edb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.048217] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.048217] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.048217] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.048217] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.048217] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.048217] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b is going to be created. [ 644.086187] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.086187] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.086187] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.086187] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.086187] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.099710] env[70764]: INFO networking_nsxv3.common.synchronization [None req-2df1cbbf-b0cd-4ff2-a34e-452ea732bc42 None None] Enqueued Resource ID: 717a9378-5a0e-4ca7-aa40-c76d3525263c with Priority: HIGHEST for action port [ 644.101329] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b in Status: UNINITIALIZED for 2s [ 644.101752] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 717a9378-5a0e-4ca7-aa40-c76d3525263c with Priority: HIGHEST for action port [ 644.102150] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-717a9378-5a0e-4ca7-aa40-c76d3525263c taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.102362] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-717a9378-5a0e-4ca7-aa40-c76d3525263c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.102455] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-717a9378-5a0e-4ca7-aa40-c76d3525263c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.102775] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-717a9378-5a0e-4ca7-aa40-c76d3525263c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.102856] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('717a9378-5a0e-4ca7-aa40-c76d3525263c',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.270766] env[70764]: INFO networking_nsxv3.common.synchronization [None req-4e911ddc-3b09-4980-b9ef-65ab62e65218 None None] Enqueued Resource ID: 637d625a-291a-4266-a791-dd32dc820ff6 with Priority: HIGHEST for action port [ 644.271381] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 637d625a-291a-4266-a791-dd32dc820ff6 with Priority: HIGHEST for action port [ 644.271693] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-637d625a-291a-4266-a791-dd32dc820ff6 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.271811] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-637d625a-291a-4266-a791-dd32dc820ff6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.272132] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-637d625a-291a-4266-a791-dd32dc820ff6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.277860] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-637d625a-291a-4266-a791-dd32dc820ff6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.277860] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('637d625a-291a-4266-a791-dd32dc820ff6',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.307975] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.307975] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.307975] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.307975] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.307975] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.307975] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port aa4d4d4e-60f3-4251-a2e3-95ae4d15e8f2 not found, creating... [ 644.307975] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.307975] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.307975] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.308833] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.308833] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.308833] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.308833] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.308833] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.309299] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.309485] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.309626] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: aa4d4d4e-60f3-4251-a2e3-95ae4d15e8f2 is going to be created. [ 644.334203] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.335138] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.335138] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.335138] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.335138] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.335653] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-aa4d4d4e-60f3-4251-a2e3-95ae4d15e8f2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.477280] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bfe698a-a7e8-4922-85ee-f21b719b7edb taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.478186] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bfe698a-a7e8-4922-85ee-f21b719b7edb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.478186] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bfe698a-a7e8-4922-85ee-f21b719b7edb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.478186] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bfe698a-a7e8-4922-85ee-f21b719b7edb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.478186] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.478186] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.478186] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.478636] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.478636] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.478636] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bfe698a-a7e8-4922-85ee-f21b719b7edb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.478636] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bfe698a-a7e8-4922-85ee-f21b719b7edb taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.478636] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bfe698a-a7e8-4922-85ee-f21b719b7edb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.478791] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bfe698a-a7e8-4922-85ee-f21b719b7edb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.478821] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bfe698a-a7e8-4922-85ee-f21b719b7edb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.479047] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.479047] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.479180] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.479213] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.479309] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.479376] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bfe698a-a7e8-4922-85ee-f21b719b7edb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.479469] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4bfe698a-a7e8-4922-85ee-f21b719b7edb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.606544] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 717a9378-5a0e-4ca7-aa40-c76d3525263c [ 644.606544] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.606544] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.606544] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.606544] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.606544] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.606544] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:717a9378-5a0e-4ca7-aa40-c76d3525263c already deleted. [ 644.606544] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-717a9378-5a0e-4ca7-aa40-c76d3525263c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.779638] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 637d625a-291a-4266-a791-dd32dc820ff6 [ 644.779638] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.779856] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.779856] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.780249] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.780555] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.780555] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:637d625a-291a-4266-a791-dd32dc820ff6 already deleted. [ 644.780723] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-637d625a-291a-4266-a791-dd32dc820ff6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.983752] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4bfe698a-a7e8-4922-85ee-f21b719b7edb: rpc.has_security_group_logging(os_id): False [ 644.997416] env[70764]: INFO networking_nsxv3.common.synchronization [req-f0539de5-8ab1-419a-abb2-e3d8f61143f0 req-ea41056d-ff47-441a-9f2c-402a08992834 tempest-ServersAdminTestJSON-868847224 tempest-ServersAdminTestJSON-868847224-project-member] Enqueued Resource ID: 5e9c0048-237b-4cab-86e0-e56dce546daa with Priority: HIGHEST for action security_group_members [ 644.998047] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e9c0048-237b-4cab-86e0-e56dce546daa with Priority: HIGHEST for action security_group_members [ 644.998377] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e9c0048-237b-4cab-86e0-e56dce546daa taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.998519] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.000443] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.000867] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.001164] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.001308] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.001392] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.001610] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.001862] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.002191] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e9c0048-237b-4cab-86e0-e56dce546daa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.005394] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.005394] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.005534] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.005846] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.006209] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.006830] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.007103] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.007209] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.007433] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.007588] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.009716] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.009716] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.009716] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.009716] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.009716] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.009716] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.009716] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.009716] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.011169] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.011169] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.011169] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4bfe698a-a7e8-4922-85ee-f21b719b7edb is going to be created. [ 645.064673] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.064673] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.064673] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.064673] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.064921] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.077691] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4bfe698a-a7e8-4922-85ee-f21b719b7edb in Status: IN_PROGRESS for 2s [ 645.460222] env[70764]: INFO networking_nsxv3.common.synchronization [None req-7bde2346-1c49-44cf-9248-837ae7ea8725 None None] Enqueued Resource ID: 8f898a26-775b-46af-89c6-33b7f0bbe1a4 with Priority: HIGHEST for action port [ 645.460910] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f898a26-775b-46af-89c6-33b7f0bbe1a4 with Priority: HIGHEST for action port [ 645.461277] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f898a26-775b-46af-89c6-33b7f0bbe1a4 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.465019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f898a26-775b-46af-89c6-33b7f0bbe1a4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.465019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f898a26-775b-46af-89c6-33b7f0bbe1a4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.465019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f898a26-775b-46af-89c6-33b7f0bbe1a4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.465019] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f898a26-775b-46af-89c6-33b7f0bbe1a4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.504513] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.504670] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.504737] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.504951] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.505061] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.505322] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.505426] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.505487] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.505651] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.505724] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.505819] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e9c0048-237b-4cab-86e0-e56dce546daa already deleted. [ 645.505895] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.837871] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-442 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.838194] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-442" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.838237] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-442" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.838546] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-442" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.838905] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.839252] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.839464] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.840057] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.840327] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.840421] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 645.840641] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 645.840856] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 645.840856] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 645.840948] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 645.841222] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 645.841222] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 645.858815] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 645.858972] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 645.859123] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 645.859297] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-442" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.859606] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-c357feec-7abc-414e-970f-abcfcef2cb01 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.859817] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-c357feec-7abc-414e-970f-abcfcef2cb01" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.859938] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-c357feec-7abc-414e-970f-abcfcef2cb01" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.860371] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-c357feec-7abc-414e-970f-abcfcef2cb01" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.860533] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c357feec-7abc-414e-970f-abcfcef2cb01',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.970158] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8f898a26-775b-46af-89c6-33b7f0bbe1a4 [ 645.970158] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.970158] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.970158] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.970158] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.970158] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.970158] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8f898a26-775b-46af-89c6-33b7f0bbe1a4 already deleted. [ 645.970158] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f898a26-775b-46af-89c6-33b7f0bbe1a4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.991698] env[70764]: INFO networking_nsxv3.common.synchronization [req-df1cb55b-a468-40c5-869d-02850d4d103c req-2ee837b7-8407-4984-a00f-580c36bb05d0 service nova] Enqueued Resource ID: f83113a5-bbfa-4011-9ddc-5d83a2a20121 with Priority: HIGHEST for action security_group_rules [ 645.991992] env[70764]: INFO networking_nsxv3.common.synchronization [req-df1cb55b-a468-40c5-869d-02850d4d103c req-2ee837b7-8407-4984-a00f-580c36bb05d0 service nova] Enqueued Resource ID: f83113a5-bbfa-4011-9ddc-5d83a2a20121 with Priority: HIGHEST for action security_group_members [ 645.991992] env[70764]: INFO networking_nsxv3.common.synchronization [req-df1cb55b-a468-40c5-869d-02850d4d103c req-2ee837b7-8407-4984-a00f-580c36bb05d0 service nova] Enqueued Resource ID: aa4d4d4e-60f3-4251-a2e3-95ae4d15e8f2 with Priority: HIGHEST for action port [ 645.992177] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f83113a5-bbfa-4011-9ddc-5d83a2a20121 with Priority: HIGHEST for action security_group_rules [ 645.992357] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f83113a5-bbfa-4011-9ddc-5d83a2a20121 with Priority: HIGHEST for action security_group_members [ 645.992513] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa4d4d4e-60f3-4251-a2e3-95ae4d15e8f2 with Priority: HIGHEST for action port [ 645.993409] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f83113a5-bbfa-4011-9ddc-5d83a2a20121 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.993567] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f83113a5-bbfa-4011-9ddc-5d83a2a20121" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.993602] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f83113a5-bbfa-4011-9ddc-5d83a2a20121" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.993974] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f83113a5-bbfa-4011-9ddc-5d83a2a20121" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.993974] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f83113a5-bbfa-4011-9ddc-5d83a2a20121',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.995290] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f83113a5-bbfa-4011-9ddc-5d83a2a20121 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.995408] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f83113a5-bbfa-4011-9ddc-5d83a2a20121" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.995474] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f83113a5-bbfa-4011-9ddc-5d83a2a20121" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.995993] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f83113a5-bbfa-4011-9ddc-5d83a2a20121" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.995993] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.995993] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.995993] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.996316] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.996316] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.996316] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f83113a5-bbfa-4011-9ddc-5d83a2a20121',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.997052] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa4d4d4e-60f3-4251-a2e3-95ae4d15e8f2 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.000334] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa4d4d4e-60f3-4251-a2e3-95ae4d15e8f2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.000411] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa4d4d4e-60f3-4251-a2e3-95ae4d15e8f2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.000600] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa4d4d4e-60f3-4251-a2e3-95ae4d15e8f2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.000646] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa4d4d4e-60f3-4251-a2e3-95ae4d15e8f2',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.114272] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b in Status: UNINITIALIZED for 4s [ 646.365032] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.365032] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.365032] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.365032] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.365032] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.365032] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port c357feec-7abc-414e-970f-abcfcef2cb01 not found, creating... [ 646.365032] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.365032] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.365032] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.365032] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.365032] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.365535] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.365535] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.365535] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.365535] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.365535] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.365699] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: c357feec-7abc-414e-970f-abcfcef2cb01 is going to be created. [ 646.388876] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.389312] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.389443] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.389775] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.390086] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.390405] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-c357feec-7abc-414e-970f-abcfcef2cb01" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.503842] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f83113a5-bbfa-4011-9ddc-5d83a2a20121 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.504081] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f83113a5-bbfa-4011-9ddc-5d83a2a20121" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.504144] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f83113a5-bbfa-4011-9ddc-5d83a2a20121',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.505076] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aa4d4d4e-60f3-4251-a2e3-95ae4d15e8f2 with status ACTIVE [ 646.505370] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.506082] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.506082] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.506082] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.506082] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.506082] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.506082] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.506082] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.506447] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.506447] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.506501] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.506580] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.506656] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.506739] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.506821] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.506897] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aa4d4d4e-60f3-4251-a2e3-95ae4d15e8f2 is going to be updated. [ 646.535291] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.535291] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.535291] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.535291] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.535588] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.535588] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa4d4d4e-60f3-4251-a2e3-95ae4d15e8f2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.010675] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f83113a5-bbfa-4011-9ddc-5d83a2a20121',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.092414] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4bfe698a-a7e8-4922-85ee-f21b719b7edb in Status: SUCCESS [ 647.092808] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4bfe698a-a7e8-4922-85ee-f21b719b7edb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.116059] env[70764]: INFO networking_nsxv3.common.synchronization [None req-de59875c-b8f5-4fbc-bfb3-1424c1c82134 None None] Enqueued Resource ID: 9a77bac3-c05a-46ef-b1b6-696aaf4e9ab8 with Priority: HIGHEST for action port [ 647.116475] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a77bac3-c05a-46ef-b1b6-696aaf4e9ab8 with Priority: HIGHEST for action port [ 647.116922] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a77bac3-c05a-46ef-b1b6-696aaf4e9ab8 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.117130] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a77bac3-c05a-46ef-b1b6-696aaf4e9ab8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.117238] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a77bac3-c05a-46ef-b1b6-696aaf4e9ab8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.117523] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a77bac3-c05a-46ef-b1b6-696aaf4e9ab8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.117652] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a77bac3-c05a-46ef-b1b6-696aaf4e9ab8',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.514206] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.514206] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.514206] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.514578] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.514578] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.514649] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f83113a5-bbfa-4011-9ddc-5d83a2a20121 is going to be created. [ 647.539316] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.539490] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.539583] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.540866] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.540866] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.551915] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f83113a5-bbfa-4011-9ddc-5d83a2a20121 in Status: UNINITIALIZED for 2s [ 647.619396] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9a77bac3-c05a-46ef-b1b6-696aaf4e9ab8 [ 647.619730] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.619920] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.619974] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.620313] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.620313] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.620408] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9a77bac3-c05a-46ef-b1b6-696aaf4e9ab8 already deleted. [ 647.620460] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a77bac3-c05a-46ef-b1b6-696aaf4e9ab8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.126443] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b in Status: SUCCESS [ 648.127258] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.127495] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.127762] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.128191] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.128191] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.128361] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.128498] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.128631] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.128846] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.128846] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.162951] env[70764]: INFO networking_nsxv3.common.synchronization [None req-1a52c468-d28b-4c0c-a288-cfcfaffc16df tempest-AttachInterfacesUnderV243Test-1674775708 tempest-AttachInterfacesUnderV243Test-1674775708-project-member] Enqueued Resource ID: 83d2b431-6671-4f07-b09d-39da26e77cad with Priority: HIGHEST for action security_group_rules [ 648.165669] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83d2b431-6671-4f07-b09d-39da26e77cad with Priority: HIGHEST for action security_group_rules [ 648.166280] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83d2b431-6671-4f07-b09d-39da26e77cad taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.170580] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.170580] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.170580] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.170580] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83d2b431-6671-4f07-b09d-39da26e77cad',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.427111] env[70764]: INFO networking_nsxv3.common.synchronization [req-f0539de5-8ab1-419a-abb2-e3d8f61143f0 req-d506a3c6-972e-4270-bf37-529dec90ae83 service nova] Enqueued Resource ID: 5e9c0048-237b-4cab-86e0-e56dce546daa with Priority: HIGHEST for action security_group_rules [ 648.427111] env[70764]: INFO networking_nsxv3.common.synchronization [req-f0539de5-8ab1-419a-abb2-e3d8f61143f0 req-d506a3c6-972e-4270-bf37-529dec90ae83 service nova] Enqueued Resource ID: 5e9c0048-237b-4cab-86e0-e56dce546daa with Priority: HIGHEST for action security_group_members [ 648.427111] env[70764]: INFO networking_nsxv3.common.synchronization [req-f0539de5-8ab1-419a-abb2-e3d8f61143f0 req-d506a3c6-972e-4270-bf37-529dec90ae83 service nova] Enqueued Resource ID: c357feec-7abc-414e-970f-abcfcef2cb01 with Priority: HIGHEST for action port [ 648.427111] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e9c0048-237b-4cab-86e0-e56dce546daa with Priority: HIGHEST for action security_group_rules [ 648.427111] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e9c0048-237b-4cab-86e0-e56dce546daa with Priority: HIGHEST for action security_group_members [ 648.427111] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c357feec-7abc-414e-970f-abcfcef2cb01 with Priority: HIGHEST for action port [ 648.427491] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e9c0048-237b-4cab-86e0-e56dce546daa taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.427610] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.427700] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.427924] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.428011] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e9c0048-237b-4cab-86e0-e56dce546daa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.429133] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e9c0048-237b-4cab-86e0-e56dce546daa taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.429253] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.429319] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.429497] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.429649] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.429743] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.429832] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.430843] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.430843] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.430843] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e9c0048-237b-4cab-86e0-e56dce546daa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.431034] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-c357feec-7abc-414e-970f-abcfcef2cb01 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.431149] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c357feec-7abc-414e-970f-abcfcef2cb01" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.431190] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c357feec-7abc-414e-970f-abcfcef2cb01" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.431331] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c357feec-7abc-414e-970f-abcfcef2cb01" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.431423] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c357feec-7abc-414e-970f-abcfcef2cb01',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.599896] env[70764]: INFO networking_nsxv3.common.synchronization [None req-7a8ccf58-907b-41c8-b59e-3db4efeede97 tempest-AttachInterfacesUnderV243Test-1674775708 tempest-AttachInterfacesUnderV243Test-1674775708-project-member] Enqueued Resource ID: 83d2b431-6671-4f07-b09d-39da26e77cad with Priority: HIGHEST for action security_group_rules [ 648.600478] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83d2b431-6671-4f07-b09d-39da26e77cad with Priority: HIGHEST for action security_group_rules [ 648.600983] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83d2b431-6671-4f07-b09d-39da26e77cad taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.600983] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.631472] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.632352] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.632534] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.632864] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.633182] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.633354] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.633597] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.633784] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.633965] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.634161] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.634394] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.634558] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.634769] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.634938] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.635209] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.635398] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.635827] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.635827] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.635827] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.636034] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.636110] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.691092] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.691396] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.691529] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.692085] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.692597] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.692597] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83d2b431-6671-4f07-b09d-39da26e77cad already deleted. [ 648.692597] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.693511] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.694446] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.694768] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83d2b431-6671-4f07-b09d-39da26e77cad',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.817754] env[70764]: INFO networking_nsxv3.common.synchronization [req-5e224b18-a19d-4a84-b682-117c738809e0 req-12ebdad8-8c72-4dfa-b38b-21664dea9d22 tempest-ServersAdminTestJSON-868847224 tempest-ServersAdminTestJSON-868847224-project-member] Enqueued Resource ID: 5e9c0048-237b-4cab-86e0-e56dce546daa with Priority: HIGHEST for action security_group_members [ 648.819548] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e9c0048-237b-4cab-86e0-e56dce546daa with Priority: HIGHEST for action security_group_members [ 648.819548] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e9c0048-237b-4cab-86e0-e56dce546daa taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.819548] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.830840] env[70764]: INFO networking_nsxv3.common.synchronization [None req-e2d902be-eba6-4d0c-a6fc-2a1d7c6389b2 None None] Enqueued Resource ID: 763680d6-cbec-46a6-9605-f8034c5acfe6 with Priority: HIGHEST for action port [ 648.831616] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 763680d6-cbec-46a6-9605-f8034c5acfe6 with Priority: HIGHEST for action port [ 648.831815] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-763680d6-cbec-46a6-9605-f8034c5acfe6 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.831943] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-763680d6-cbec-46a6-9605-f8034c5acfe6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.832012] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-763680d6-cbec-46a6-9605-f8034c5acfe6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.832299] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-763680d6-cbec-46a6-9605-f8034c5acfe6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.832387] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('763680d6-cbec-46a6-9605-f8034c5acfe6',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.933116] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e9c0048-237b-4cab-86e0-e56dce546daa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.934239] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e9c0048-237b-4cab-86e0-e56dce546daa taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.934354] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.934812] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c357feec-7abc-414e-970f-abcfcef2cb01 with status ACTIVE [ 648.934875] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.934990] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.935071] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.935255] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.935417] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.935616] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.935719] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.935814] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.935982] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.936075] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.936256] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.936360] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.936434] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.936574] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.936742] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.936742] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c357feec-7abc-414e-970f-abcfcef2cb01 is going to be updated. [ 648.983796] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.983796] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.984038] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.984604] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.984861] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.984988] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c357feec-7abc-414e-970f-abcfcef2cb01" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.138898] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c2d79e00-b6b0-41f3-96fb-49ab2b10751b: rpc.has_security_group_logging(os_id): False [ 649.158397] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.158509] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.158573] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.158825] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.158913] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.159194] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.159312] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.159378] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.159563] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.159643] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.159863] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.159975] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.160053] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.160208] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.160299] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.160498] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.160631] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.160700] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.160849] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.160927] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.161009] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b is going to be created. [ 649.219520] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.221433] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.221433] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.221433] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.221433] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.221433] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83d2b431-6671-4f07-b09d-39da26e77cad already deleted. [ 649.221433] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.238884] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.239324] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.239728] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.240072] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.240293] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.254729] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b in Status: IN_PROGRESS for 2s [ 649.335128] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 763680d6-cbec-46a6-9605-f8034c5acfe6 [ 649.335128] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.335128] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.335128] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.335128] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.335490] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.335490] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:763680d6-cbec-46a6-9605-f8034c5acfe6 already deleted. [ 649.335490] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-763680d6-cbec-46a6-9605-f8034c5acfe6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.435968] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e9c0048-237b-4cab-86e0-e56dce546daa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.563134] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f83113a5-bbfa-4011-9ddc-5d83a2a20121 in Status: SUCCESS [ 649.563366] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f83113a5-bbfa-4011-9ddc-5d83a2a20121" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.563534] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f83113a5-bbfa-4011-9ddc-5d83a2a20121" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.563756] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f83113a5-bbfa-4011-9ddc-5d83a2a20121" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.563959] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.564099] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.564163] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.564329] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.564394] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.564482] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f83113a5-bbfa-4011-9ddc-5d83a2a20121" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.564573] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f83113a5-bbfa-4011-9ddc-5d83a2a20121',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.897704] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-442 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.897933] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-442" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.898064] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-442" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.898406] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-442" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.898755] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.898932] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.900129] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.902106] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.902106] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.902106] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 649.902106] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 649.902106] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 649.902106] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 649.902106] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 649.902106] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 649.902106] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 649.922353] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 649.922353] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 649.922353] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 649.922353] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-442" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.922353] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-33c0e220-8db1-4b07-b3b7-1a5dc14d892c taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.922353] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-33c0e220-8db1-4b07-b3b7-1a5dc14d892c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.922353] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-33c0e220-8db1-4b07-b3b7-1a5dc14d892c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.922353] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-33c0e220-8db1-4b07-b3b7-1a5dc14d892c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.922795] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33c0e220-8db1-4b07-b3b7-1a5dc14d892c',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.938481] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.938661] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.938781] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.939163] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.939163] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.939378] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e9c0048-237b-4cab-86e0-e56dce546daa is going to be created. [ 649.963352] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.963352] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.963352] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.963352] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.963352] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.975160] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e9c0048-237b-4cab-86e0-e56dce546daa in Status: UNINITIALIZED for 2s [ 650.067233] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f83113a5-bbfa-4011-9ddc-5d83a2a20121',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.343334] env[70764]: INFO networking_nsxv3.common.synchronization [None req-2462b21f-8259-4bc6-9857-e4e167182eb0 None None] Enqueued Resource ID: 35fc130d-d152-4036-ade1-440bfeef2764 with Priority: HIGHEST for action port [ 650.343926] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35fc130d-d152-4036-ade1-440bfeef2764 with Priority: HIGHEST for action port [ 650.344274] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-35fc130d-d152-4036-ade1-440bfeef2764 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.344404] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35fc130d-d152-4036-ade1-440bfeef2764" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.344469] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35fc130d-d152-4036-ade1-440bfeef2764" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.346193] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35fc130d-d152-4036-ade1-440bfeef2764" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.346277] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35fc130d-d152-4036-ade1-440bfeef2764',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.424903] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.425151] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.425273] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.425543] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.425686] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.425850] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 33c0e220-8db1-4b07-b3b7-1a5dc14d892c not found, creating... [ 650.428169] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.428438] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.428563] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.428808] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.429651] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.429651] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.429651] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.429651] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.429801] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.430155] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.430155] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 33c0e220-8db1-4b07-b3b7-1a5dc14d892c is going to be created. [ 650.449315] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.449560] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.449680] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.449979] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.450216] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.450434] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-33c0e220-8db1-4b07-b3b7-1a5dc14d892c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.569597] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f83113a5-bbfa-4011-9ddc-5d83a2a20121: rpc.has_security_group_logging(os_id): False [ 650.592964] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.593132] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.593204] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.593504] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.593614] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.593911] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.594437] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.594437] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.594437] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.594437] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.594437] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f83113a5-bbfa-4011-9ddc-5d83a2a20121 is going to be created. [ 650.607497] env[70764]: INFO networking_nsxv3.common.synchronization [None req-c1db88b0-6cd6-45a5-b108-43b9ca3a3ec3 None None] Enqueued Resource ID: fc278f14-6614-453a-8727-8470b38f7c9f with Priority: HIGHEST for action port [ 650.607759] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc278f14-6614-453a-8727-8470b38f7c9f with Priority: HIGHEST for action port [ 650.608328] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc278f14-6614-453a-8727-8470b38f7c9f taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.608630] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc278f14-6614-453a-8727-8470b38f7c9f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.608701] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc278f14-6614-453a-8727-8470b38f7c9f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.609530] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc278f14-6614-453a-8727-8470b38f7c9f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.609530] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc278f14-6614-453a-8727-8470b38f7c9f',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.671669] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.671669] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.671669] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.671669] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.671669] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.685579] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f83113a5-bbfa-4011-9ddc-5d83a2a20121 in Status: IN_PROGRESS for 2s [ 650.849493] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 35fc130d-d152-4036-ade1-440bfeef2764 [ 650.849493] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.849493] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.849493] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.849493] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.849493] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.849493] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:35fc130d-d152-4036-ade1-440bfeef2764 already deleted. [ 650.849493] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35fc130d-d152-4036-ade1-440bfeef2764" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.111583] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fc278f14-6614-453a-8727-8470b38f7c9f [ 651.112245] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.113844] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.113844] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.113844] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.113844] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.113844] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fc278f14-6614-453a-8727-8470b38f7c9f already deleted. [ 651.113844] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc278f14-6614-453a-8727-8470b38f7c9f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.266594] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b in Status: SUCCESS [ 651.268393] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.297815] env[70764]: INFO networking_nsxv3.common.synchronization [None req-79001624-f3f4-427f-b828-4896ea164fd0 None None] Enqueued Resource ID: 72b4a5a3-2c12-4816-8782-33c4e2baadf6 with Priority: HIGHEST for action port [ 651.297815] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72b4a5a3-2c12-4816-8782-33c4e2baadf6 with Priority: HIGHEST for action port [ 651.298035] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-72b4a5a3-2c12-4816-8782-33c4e2baadf6 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.299752] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72b4a5a3-2c12-4816-8782-33c4e2baadf6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.299752] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72b4a5a3-2c12-4816-8782-33c4e2baadf6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.300124] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72b4a5a3-2c12-4816-8782-33c4e2baadf6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.300233] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72b4a5a3-2c12-4816-8782-33c4e2baadf6',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.304148] env[70764]: INFO networking_nsxv3.common.synchronization [req-5e224b18-a19d-4a84-b682-117c738809e0 req-f8d5ed74-8490-4787-9dfe-34fdf9477181 service nova] Enqueued Resource ID: 5e9c0048-237b-4cab-86e0-e56dce546daa with Priority: HIGHEST for action security_group_rules [ 651.304892] env[70764]: INFO networking_nsxv3.common.synchronization [req-5e224b18-a19d-4a84-b682-117c738809e0 req-f8d5ed74-8490-4787-9dfe-34fdf9477181 service nova] Enqueued Resource ID: 5e9c0048-237b-4cab-86e0-e56dce546daa with Priority: HIGHEST for action security_group_members [ 651.304892] env[70764]: INFO networking_nsxv3.common.synchronization [req-5e224b18-a19d-4a84-b682-117c738809e0 req-f8d5ed74-8490-4787-9dfe-34fdf9477181 service nova] Enqueued Resource ID: 33c0e220-8db1-4b07-b3b7-1a5dc14d892c with Priority: HIGHEST for action port [ 651.309040] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e9c0048-237b-4cab-86e0-e56dce546daa with Priority: HIGHEST for action security_group_rules [ 651.309040] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e9c0048-237b-4cab-86e0-e56dce546daa with Priority: HIGHEST for action security_group_members [ 651.309040] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33c0e220-8db1-4b07-b3b7-1a5dc14d892c with Priority: HIGHEST for action port [ 651.309040] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e9c0048-237b-4cab-86e0-e56dce546daa taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.309040] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.309040] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e9c0048-237b-4cab-86e0-e56dce546daa taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.309040] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.309880] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-33c0e220-8db1-4b07-b3b7-1a5dc14d892c taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.309880] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33c0e220-8db1-4b07-b3b7-1a5dc14d892c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.309880] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33c0e220-8db1-4b07-b3b7-1a5dc14d892c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.310178] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33c0e220-8db1-4b07-b3b7-1a5dc14d892c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.310178] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33c0e220-8db1-4b07-b3b7-1a5dc14d892c',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.430556] env[70764]: INFO networking_nsxv3.common.synchronization [req-59341533-b409-44ac-bda5-0c0c96a6aa55 req-30a9394c-b9a0-440a-a7b6-39499511f868 tempest-SecurityGroupRulesTestJSON-86292721 tempest-SecurityGroupRulesTestJSON-86292721-project-member] Enqueued Resource ID: def4df50-283e-46b1-aeeb-3e9c8ffc76de with Priority: HIGHEST for action security_group_rules [ 651.430556] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: def4df50-283e-46b1-aeeb-3e9c8ffc76de with Priority: HIGHEST for action security_group_rules [ 651.433577] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-def4df50-283e-46b1-aeeb-3e9c8ffc76de taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.433577] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-def4df50-283e-46b1-aeeb-3e9c8ffc76de" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.433577] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-def4df50-283e-46b1-aeeb-3e9c8ffc76de" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.433577] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-def4df50-283e-46b1-aeeb-3e9c8ffc76de" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.433577] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('def4df50-283e-46b1-aeeb-3e9c8ffc76de',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.548222] env[70764]: INFO networking_nsxv3.common.synchronization [None req-1699b3a5-d795-49ef-ac02-5efee30ff209 None None] Enqueued Resource ID: f818080d-1c31-4ccf-a05f-c6e0c859c429 with Priority: HIGHEST for action port [ 651.548222] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f818080d-1c31-4ccf-a05f-c6e0c859c429 with Priority: HIGHEST for action port [ 651.548222] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-f818080d-1c31-4ccf-a05f-c6e0c859c429 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.548222] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f818080d-1c31-4ccf-a05f-c6e0c859c429" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.548222] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f818080d-1c31-4ccf-a05f-c6e0c859c429" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.548222] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f818080d-1c31-4ccf-a05f-c6e0c859c429" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.548222] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f818080d-1c31-4ccf-a05f-c6e0c859c429',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.806886] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 72b4a5a3-2c12-4816-8782-33c4e2baadf6 [ 651.808562] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.808562] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.808562] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.808562] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.808562] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.808562] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:72b4a5a3-2c12-4816-8782-33c4e2baadf6 already deleted. [ 651.808562] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72b4a5a3-2c12-4816-8782-33c4e2baadf6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.816961] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 33c0e220-8db1-4b07-b3b7-1a5dc14d892c with status ACTIVE [ 651.817209] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.820921] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.820921] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.820921] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.820921] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.820921] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.820921] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.821649] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.821649] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.821649] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.821649] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.821649] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.821649] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.821965] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.821965] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.821965] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 33c0e220-8db1-4b07-b3b7-1a5dc14d892c is going to be updated. [ 651.850796] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.852414] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.852414] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.852414] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.852414] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.852414] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33c0e220-8db1-4b07-b3b7-1a5dc14d892c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.964278] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.964488] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.964569] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.965349] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.965349] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.965349] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: def4df50-283e-46b1-aeeb-3e9c8ffc76de already deleted. [ 651.965349] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-def4df50-283e-46b1-aeeb-3e9c8ffc76de" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.989206] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e9c0048-237b-4cab-86e0-e56dce546daa in Status: SUCCESS [ 651.990358] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.995042] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.995042] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.995042] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.995042] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.995042] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.995042] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.995042] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.995042] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e9c0048-237b-4cab-86e0-e56dce546daa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.051087] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f818080d-1c31-4ccf-a05f-c6e0c859c429 [ 652.052686] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.052686] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.052686] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.052686] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.052686] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.052686] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f818080d-1c31-4ccf-a05f-c6e0c859c429 already deleted. [ 652.052686] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f818080d-1c31-4ccf-a05f-c6e0c859c429" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.483865] env[70764]: INFO networking_nsxv3.common.synchronization [req-50d029a4-b560-4b46-a2d8-fddbc77e3dc8 req-796f8bf9-c7b7-428c-97f6-b268d27e9682 tempest-DeleteServersAdminTestJSON-1989096706 tempest-DeleteServersAdminTestJSON-1989096706-project-admin] Enqueued Resource ID: 053f53ee-d0a4-4067-829d-5dc886808f18 with Priority: HIGHEST for action security_group_members [ 652.483865] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 053f53ee-d0a4-4067-829d-5dc886808f18 with Priority: HIGHEST for action security_group_members [ 652.484255] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-053f53ee-d0a4-4067-829d-5dc886808f18 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.484381] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.484424] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.484613] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.485169] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.485322] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.485371] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.485518] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.485601] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.485693] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('053f53ee-d0a4-4067-829d-5dc886808f18',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.501020] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e9c0048-237b-4cab-86e0-e56dce546daa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.696501] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f83113a5-bbfa-4011-9ddc-5d83a2a20121 in Status: SUCCESS [ 652.696501] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f83113a5-bbfa-4011-9ddc-5d83a2a20121" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.989991] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.991303] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.991303] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.991303] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.991303] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.991303] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.991303] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.992887] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.992887] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.992887] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.992887] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 053f53ee-d0a4-4067-829d-5dc886808f18 is going to be updated. [ 652.998889] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e9c0048-237b-4cab-86e0-e56dce546daa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.017100] env[70764]: INFO networking_nsxv3.common.synchronization [None req-0a133f71-a495-4515-9a8f-4c8c0af3bec2 None None] Enqueued Resource ID: f9ec19cd-99fd-44d6-99a2-cc9aa655730c with Priority: HIGHEST for action port [ 653.019560] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9ec19cd-99fd-44d6-99a2-cc9aa655730c with Priority: HIGHEST for action port [ 653.019560] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-f9ec19cd-99fd-44d6-99a2-cc9aa655730c taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.019560] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f9ec19cd-99fd-44d6-99a2-cc9aa655730c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.019687] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f9ec19cd-99fd-44d6-99a2-cc9aa655730c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.020052] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f9ec19cd-99fd-44d6-99a2-cc9aa655730c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.020172] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9ec19cd-99fd-44d6-99a2-cc9aa655730c',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.022960] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.022960] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.022960] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.023374] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.023374] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.033033] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 053f53ee-d0a4-4067-829d-5dc886808f18 in Status: IN_PROGRESS for 2s [ 653.081162] env[70764]: INFO networking_nsxv3.common.synchronization [req-9e67262f-aded-4425-bec8-fb6e1b55fef2 req-4bb3f6bc-1aa1-406f-8c43-4d02c7873e34 tempest-ServersWithSpecificFlavorTestJSON-440557435 tempest-ServersWithSpecificFlavorTestJSON-440557435-project-member] Enqueued Resource ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 with Priority: HIGHEST for action security_group_members [ 653.081211] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 with Priority: HIGHEST for action security_group_members [ 653.081537] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-380030c5-e260-46fb-aa7e-5000c5bc9507 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.081664] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.081738] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.082118] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.082503] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.082628] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.082694] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.082944] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.082944] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.083075] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('380030c5-e260-46fb-aa7e-5000c5bc9507',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.499953] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-36 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.499953] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-36" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.499953] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-36" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.499953] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-36" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.499953] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.499953] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.499953] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.499953] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.499953] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.499953] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 653.499953] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 653.499953] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 653.499953] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 653.500827] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 653.500827] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 653.500827] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 653.505037] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.505037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.505037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.505037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.505037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.505037] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e9c0048-237b-4cab-86e0-e56dce546daa is going to be updated. [ 653.522457] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 653.522733] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 653.522881] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 653.523139] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-36" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.523871] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-6d8a473f-d4ea-45f1-aac7-b9fd03ad9310 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.523871] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-6d8a473f-d4ea-45f1-aac7-b9fd03ad9310" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.523871] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-6d8a473f-d4ea-45f1-aac7-b9fd03ad9310" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.524368] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-6d8a473f-d4ea-45f1-aac7-b9fd03ad9310" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.524598] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d8a473f-d4ea-45f1-aac7-b9fd03ad9310',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.526328] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f9ec19cd-99fd-44d6-99a2-cc9aa655730c [ 653.526328] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.526475] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.526521] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.526680] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.526784] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.526833] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f9ec19cd-99fd-44d6-99a2-cc9aa655730c already deleted. [ 653.526927] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f9ec19cd-99fd-44d6-99a2-cc9aa655730c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.533395] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.533526] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.534146] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.534535] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.534679] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.544052] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e9c0048-237b-4cab-86e0-e56dce546daa in Status: IN_PROGRESS for 2s [ 653.585860] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.585980] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.586385] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.586385] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.586385] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.587096] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.587202] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.587242] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.587484] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.587484] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.587652] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 already deleted. [ 653.587652] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.644102] env[70764]: INFO networking_nsxv3.common.synchronization [req-ce306a5e-be6c-448b-8345-60370abf6e0c req-2383289b-b701-4ff3-95e9-6fc78abb75cf tempest-SecurityGroupRulesTestJSON-86292721 tempest-SecurityGroupRulesTestJSON-86292721-project-member] Enqueued Resource ID: def4df50-283e-46b1-aeeb-3e9c8ffc76de with Priority: HIGHEST for action security_group_rules [ 653.644650] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: def4df50-283e-46b1-aeeb-3e9c8ffc76de with Priority: HIGHEST for action security_group_rules [ 653.644962] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-def4df50-283e-46b1-aeeb-3e9c8ffc76de taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.645113] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-def4df50-283e-46b1-aeeb-3e9c8ffc76de" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.645411] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-def4df50-283e-46b1-aeeb-3e9c8ffc76de" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.645454] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-def4df50-283e-46b1-aeeb-3e9c8ffc76de" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.645534] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('def4df50-283e-46b1-aeeb-3e9c8ffc76de',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.804811] env[70764]: INFO networking_nsxv3.common.synchronization [None req-eb777b6b-6a6a-414b-89f7-7c62042655da None None] Enqueued Resource ID: 2fc6f552-9c1c-4f28-84fc-3d52df5f744d with Priority: HIGHEST for action port [ 653.805635] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fc6f552-9c1c-4f28-84fc-3d52df5f744d with Priority: HIGHEST for action port [ 653.806541] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-2fc6f552-9c1c-4f28-84fc-3d52df5f744d taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.806690] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2fc6f552-9c1c-4f28-84fc-3d52df5f744d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.806690] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2fc6f552-9c1c-4f28-84fc-3d52df5f744d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.806960] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2fc6f552-9c1c-4f28-84fc-3d52df5f744d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.807032] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2fc6f552-9c1c-4f28-84fc-3d52df5f744d',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.028793] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.030785] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.030785] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.030895] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.031030] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.031189] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 6d8a473f-d4ea-45f1-aac7-b9fd03ad9310 not found, creating... [ 654.031471] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.031998] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.031998] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.031998] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.032389] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.032557] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.032718] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.032834] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.033246] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.033246] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.033321] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 6d8a473f-d4ea-45f1-aac7-b9fd03ad9310 is going to be created. [ 654.055493] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.057036] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.057036] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.057159] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.057366] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.057557] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-6d8a473f-d4ea-45f1-aac7-b9fd03ad9310" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.171348] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.171798] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.171932] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.172215] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.172368] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.172537] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: def4df50-283e-46b1-aeeb-3e9c8ffc76de already deleted. [ 654.172722] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-def4df50-283e-46b1-aeeb-3e9c8ffc76de" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.309378] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2fc6f552-9c1c-4f28-84fc-3d52df5f744d [ 654.309627] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.309765] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.309883] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.310147] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.310243] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.310348] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2fc6f552-9c1c-4f28-84fc-3d52df5f744d already deleted. [ 654.310432] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2fc6f552-9c1c-4f28-84fc-3d52df5f744d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.042774] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 053f53ee-d0a4-4067-829d-5dc886808f18 in Status: SUCCESS [ 655.043159] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 053f53ee-d0a4-4067-829d-5dc886808f18 deletion is rescheduled due to dependency. [ 655.043286] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.066493] env[70764]: INFO networking_nsxv3.common.synchronization [req-9e67262f-aded-4425-bec8-fb6e1b55fef2 req-c59d5801-2938-4c35-881a-cc93d853038f service nova] Enqueued Resource ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 with Priority: HIGHEST for action security_group_rules [ 655.066662] env[70764]: INFO networking_nsxv3.common.synchronization [req-9e67262f-aded-4425-bec8-fb6e1b55fef2 req-c59d5801-2938-4c35-881a-cc93d853038f service nova] Enqueued Resource ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 with Priority: HIGHEST for action security_group_members [ 655.066797] env[70764]: INFO networking_nsxv3.common.synchronization [req-9e67262f-aded-4425-bec8-fb6e1b55fef2 req-c59d5801-2938-4c35-881a-cc93d853038f service nova] Enqueued Resource ID: 6d8a473f-d4ea-45f1-aac7-b9fd03ad9310 with Priority: HIGHEST for action port [ 655.070273] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 with Priority: HIGHEST for action security_group_rules [ 655.070273] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 with Priority: HIGHEST for action security_group_members [ 655.070273] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d8a473f-d4ea-45f1-aac7-b9fd03ad9310 with Priority: HIGHEST for action port [ 655.070273] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-380030c5-e260-46fb-aa7e-5000c5bc9507 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.070697] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.070697] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.070697] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.070697] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('380030c5-e260-46fb-aa7e-5000c5bc9507',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.071662] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-380030c5-e260-46fb-aa7e-5000c5bc9507 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.071782] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.071944] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.072058] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.072556] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.072718] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.072810] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.072985] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.073087] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.073237] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('380030c5-e260-46fb-aa7e-5000c5bc9507',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.074648] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d8a473f-d4ea-45f1-aac7-b9fd03ad9310 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.074648] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d8a473f-d4ea-45f1-aac7-b9fd03ad9310" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.074648] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d8a473f-d4ea-45f1-aac7-b9fd03ad9310" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.074648] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d8a473f-d4ea-45f1-aac7-b9fd03ad9310" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.074648] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d8a473f-d4ea-45f1-aac7-b9fd03ad9310',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.556366] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e9c0048-237b-4cab-86e0-e56dce546daa in Status: SUCCESS [ 655.556602] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.556793] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.556980] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.558820] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.558820] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.558820] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.558820] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.558820] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.558820] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.558820] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e9c0048-237b-4cab-86e0-e56dce546daa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.559322] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.559322] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.559482] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.559622] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.559771] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.559983] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.560106] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.560236] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e9c0048-237b-4cab-86e0-e56dce546daa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.577398] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-380030c5-e260-46fb-aa7e-5000c5bc9507 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.577817] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.578286] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('380030c5-e260-46fb-aa7e-5000c5bc9507',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.579600] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6d8a473f-d4ea-45f1-aac7-b9fd03ad9310 with status ACTIVE [ 655.581251] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.581439] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.581543] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.582061] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.582061] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.582381] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.582581] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.582581] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.583108] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.583246] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.585275] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.585386] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.585496] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.586240] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.586240] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.586240] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6d8a473f-d4ea-45f1-aac7-b9fd03ad9310 is going to be updated. [ 655.590444] env[70764]: INFO networking_nsxv3.common.synchronization [req-4e040267-c0b9-4b81-b5e3-6770795bd61c req-017530b4-8fa9-457a-abd4-cef942351637 tempest-ServersTestJSON-88830314 tempest-ServersTestJSON-88830314-project-member] Enqueued Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_members [ 655.591694] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_members [ 655.593219] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.593367] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.593469] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.594667] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.595060] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.595152] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.595189] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.595402] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.595678] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.595678] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.609649] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.609957] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.610075] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.610369] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.610566] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.610807] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d8a473f-d4ea-45f1-aac7-b9fd03ad9310" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.064200] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e9c0048-237b-4cab-86e0-e56dce546daa taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.064200] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.064200] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e9c0048-237b-4cab-86e0-e56dce546daa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.080017] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('380030c5-e260-46fb-aa7e-5000c5bc9507',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.099957] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.100162] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.100220] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.100443] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.100552] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.100731] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.100829] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.100829] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.101048] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.101125] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.101211] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8f5efec-a14e-4be6-8add-7b35a995c982 already deleted. [ 656.101319] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.290241] env[70764]: INFO networking_nsxv3.common.synchronization [req-8950877b-591b-47b2-8775-a23761c9953b req-d9115e81-1a27-408a-bfff-902ce36c12fc tempest-ServerDiagnosticsTest-1379378422 tempest-ServerDiagnosticsTest-1379378422-project-member] Enqueued Resource ID: 8e62e528-352b-40bb-8f9d-c7bb50b75dff with Priority: HIGHEST for action security_group_members [ 656.290241] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e62e528-352b-40bb-8f9d-c7bb50b75dff with Priority: HIGHEST for action security_group_members [ 656.290241] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e62e528-352b-40bb-8f9d-c7bb50b75dff taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.290241] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e62e528-352b-40bb-8f9d-c7bb50b75dff" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.290241] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e62e528-352b-40bb-8f9d-c7bb50b75dff" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.290838] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e62e528-352b-40bb-8f9d-c7bb50b75dff" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.291209] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.291453] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.291611] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.291881] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.292659] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.292863] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e62e528-352b-40bb-8f9d-c7bb50b75dff',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.566043] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e9c0048-237b-4cab-86e0-e56dce546daa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.582756] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.582918] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.582992] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.583248] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.583344] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.583447] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 is going to be created. [ 656.605652] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.605825] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.605825] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.606203] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.606203] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.614667] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 in Status: UNINITIALIZED for 2s [ 656.703016] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-603 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.703272] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-603" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.704207] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-603" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.704207] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-603" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.704207] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.704467] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.704631] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.707056] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.707056] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.707056] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 656.707056] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 656.707056] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 656.707056] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 656.707056] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 656.707056] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 656.707056] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 656.725195] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 656.725195] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 656.725195] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 656.725195] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-603" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.725195] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-a5b985ab-b183-4f58-a1a8-c0e3bdf6c096 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.725443] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-a5b985ab-b183-4f58-a1a8-c0e3bdf6c096" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.725698] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-a5b985ab-b183-4f58-a1a8-c0e3bdf6c096" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.725881] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-a5b985ab-b183-4f58-a1a8-c0e3bdf6c096" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.727038] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5b985ab-b183-4f58-a1a8-c0e3bdf6c096',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.795081] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.795333] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.795333] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.795555] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.795646] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.795890] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.795967] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.796043] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.796254] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.796360] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.796360] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e62e528-352b-40bb-8f9d-c7bb50b75dff is going to be updated. [ 656.820650] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.820788] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.820920] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.821081] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.821230] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.829591] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e62e528-352b-40bb-8f9d-c7bb50b75dff in Status: IN_PROGRESS for 2s [ 657.067915] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.072135] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.072135] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.072135] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.072135] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.072135] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e9c0048-237b-4cab-86e0-e56dce546daa is going to be updated. [ 657.120488] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.120762] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.120899] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.123338] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.123338] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.132598] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e9c0048-237b-4cab-86e0-e56dce546daa in Status: IN_PROGRESS for 2s [ 657.229688] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.230177] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.230450] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.230615] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.230919] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.230919] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port a5b985ab-b183-4f58-a1a8-c0e3bdf6c096 not found, creating... [ 657.231212] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.231500] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.231500] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.231760] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.231836] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.232466] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.232466] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.232466] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.233496] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.233631] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.238228] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: a5b985ab-b183-4f58-a1a8-c0e3bdf6c096 is going to be created. [ 657.269261] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.269512] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.269646] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.269999] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.270670] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.270670] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-a5b985ab-b183-4f58-a1a8-c0e3bdf6c096" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.742734] env[70764]: INFO networking_nsxv3.common.synchronization [None req-e7555aa4-658a-47bc-a1c1-a504c6dbadac None None] Enqueued Resource ID: cb2d64fb-bfc2-48cd-a1e1-218853c8cf29 with Priority: HIGHEST for action port [ 657.742841] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb2d64fb-bfc2-48cd-a1e1-218853c8cf29 with Priority: HIGHEST for action port [ 657.743455] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb2d64fb-bfc2-48cd-a1e1-218853c8cf29 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.743574] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb2d64fb-bfc2-48cd-a1e1-218853c8cf29" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.743642] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb2d64fb-bfc2-48cd-a1e1-218853c8cf29" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.746737] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb2d64fb-bfc2-48cd-a1e1-218853c8cf29" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.746934] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb2d64fb-bfc2-48cd-a1e1-218853c8cf29',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.870296] env[70764]: INFO networking_nsxv3.common.synchronization [req-6343b2c4-6e27-42f7-89cf-1578b6609372 req-ac323b2e-a8f4-476f-8a3b-df4f0b4350b0 tempest-SecurityGroupsTestJSON-512195178 tempest-SecurityGroupsTestJSON-512195178-project-member] Enqueued Resource ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b with Priority: HIGHEST for action security_group_members [ 657.870296] env[70764]: INFO networking_nsxv3.common.synchronization [req-6343b2c4-6e27-42f7-89cf-1578b6609372 req-ac323b2e-a8f4-476f-8a3b-df4f0b4350b0 tempest-SecurityGroupsTestJSON-512195178 tempest-SecurityGroupsTestJSON-512195178-project-member] Enqueued Resource ID: 18c40e3b-51cd-431a-858a-22168889b4fd with Priority: HIGHEST for action security_group_members [ 657.870296] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b with Priority: HIGHEST for action security_group_members [ 657.870878] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18c40e3b-51cd-431a-858a-22168889b4fd with Priority: HIGHEST for action security_group_members [ 657.870878] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.870878] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.871092] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.871127] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.871351] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.871695] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.871767] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.872788] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.872788] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.872788] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.873762] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-18c40e3b-51cd-431a-858a-22168889b4fd taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.873762] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18c40e3b-51cd-431a-858a-22168889b4fd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.873762] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18c40e3b-51cd-431a-858a-22168889b4fd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.874048] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18c40e3b-51cd-431a-858a-22168889b4fd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.874215] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.874332] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.874409] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.874963] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.875034] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.875134] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18c40e3b-51cd-431a-858a-22168889b4fd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.152957] env[70764]: INFO networking_nsxv3.common.synchronization [req-6343b2c4-6e27-42f7-89cf-1578b6609372 req-ac323b2e-a8f4-476f-8a3b-df4f0b4350b0 tempest-SecurityGroupsTestJSON-512195178 tempest-SecurityGroupsTestJSON-512195178-project-member] Enqueued Resource ID: 18c40e3b-51cd-431a-858a-22168889b4fd with Priority: HIGHEST for action security_group_rules [ 658.153221] env[70764]: INFO networking_nsxv3.common.synchronization [req-6343b2c4-6e27-42f7-89cf-1578b6609372 req-ac323b2e-a8f4-476f-8a3b-df4f0b4350b0 tempest-SecurityGroupsTestJSON-512195178 tempest-SecurityGroupsTestJSON-512195178-project-member] Enqueued Resource ID: 18c40e3b-51cd-431a-858a-22168889b4fd with Priority: HIGHEST for action security_group_members [ 658.153221] env[70764]: INFO networking_nsxv3.common.synchronization [req-6343b2c4-6e27-42f7-89cf-1578b6609372 req-ac323b2e-a8f4-476f-8a3b-df4f0b4350b0 tempest-SecurityGroupsTestJSON-512195178 tempest-SecurityGroupsTestJSON-512195178-project-member] Enqueued Resource ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b with Priority: HIGHEST for action security_group_rules [ 658.153290] env[70764]: INFO networking_nsxv3.common.synchronization [req-6343b2c4-6e27-42f7-89cf-1578b6609372 req-ac323b2e-a8f4-476f-8a3b-df4f0b4350b0 tempest-SecurityGroupsTestJSON-512195178 tempest-SecurityGroupsTestJSON-512195178-project-member] Enqueued Resource ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b with Priority: HIGHEST for action security_group_members [ 658.153390] env[70764]: INFO networking_nsxv3.common.synchronization [req-6343b2c4-6e27-42f7-89cf-1578b6609372 req-ac323b2e-a8f4-476f-8a3b-df4f0b4350b0 tempest-SecurityGroupsTestJSON-512195178 tempest-SecurityGroupsTestJSON-512195178-project-member] Enqueued Resource ID: c2694d3f-527f-4890-bf9d-62a74f11b251 with Priority: HIGHEST for action port [ 658.154092] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18c40e3b-51cd-431a-858a-22168889b4fd with Priority: HIGHEST for action security_group_rules [ 658.154853] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b with Priority: HIGHEST for action security_group_rules [ 658.154853] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2694d3f-527f-4890-bf9d-62a74f11b251 with Priority: HIGHEST for action port [ 658.155100] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18c40e3b-51cd-431a-858a-22168889b4fd with Priority: HIGHEST for action security_group_members [ 658.155484] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b with Priority: HIGHEST for action security_group_members [ 658.155728] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18c40e3b-51cd-431a-858a-22168889b4fd taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.155728] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18c40e3b-51cd-431a-858a-22168889b4fd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.155954] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18c40e3b-51cd-431a-858a-22168889b4fd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.156444] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18c40e3b-51cd-431a-858a-22168889b4fd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.156444] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18c40e3b-51cd-431a-858a-22168889b4fd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.158331] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c2d79e00-b6b0-41f3-96fb-49ab2b10751b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.158331] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.158331] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.158331] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.158331] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.160392] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2694d3f-527f-4890-bf9d-62a74f11b251 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.160392] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2694d3f-527f-4890-bf9d-62a74f11b251" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.160499] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2694d3f-527f-4890-bf9d-62a74f11b251" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.163622] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2694d3f-527f-4890-bf9d-62a74f11b251" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.163622] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2694d3f-527f-4890-bf9d-62a74f11b251',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.163622] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-18c40e3b-51cd-431a-858a-22168889b4fd taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.163622] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18c40e3b-51cd-431a-858a-22168889b4fd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.163622] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.163622] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.250047] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cb2d64fb-bfc2-48cd-a1e1-218853c8cf29 [ 658.251557] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.251765] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.251878] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.252311] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.252311] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.252827] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cb2d64fb-bfc2-48cd-a1e1-218853c8cf29 already deleted. [ 658.252827] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb2d64fb-bfc2-48cd-a1e1-218853c8cf29" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.379508] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.379508] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('18c40e3b-51cd-431a-858a-22168889b4fd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.626742] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 in Status: SUCCESS [ 658.626742] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.626742] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.626742] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.626742] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.626742] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.626742] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.626742] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.626742] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.626742] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.626742] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('380030c5-e260-46fb-aa7e-5000c5bc9507',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.665696] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-18c40e3b-51cd-431a-858a-22168889b4fd taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.665951] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18c40e3b-51cd-431a-858a-22168889b4fd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.666252] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c2694d3f-527f-4890-bf9d-62a74f11b251 with status ACTIVE [ 658.666252] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.666356] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.666356] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.666554] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.666644] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.666810] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.666910] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.666985] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.667155] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.667313] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.667408] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.667488] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.667568] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.667728] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.667760] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.667851] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c2694d3f-527f-4890-bf9d-62a74f11b251 is going to be updated. [ 658.669527] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.669631] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.688604] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.688604] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.688604] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.688781] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.688886] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.689063] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2694d3f-527f-4890-bf9d-62a74f11b251" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.803272] env[70764]: INFO networking_nsxv3.common.synchronization [req-c1802fc1-3fc1-46aa-b1ab-fa20adda399e req-93dd61dc-21f1-4186-a4df-2745cd6eceed tempest-ServerDiagnosticsNegativeTest-1553550798 tempest-ServerDiagnosticsNegativeTest-1553550798-project-member] Enqueued Resource ID: f9c2bf07-cd28-4135-994d-30a9140bcc35 with Priority: HIGHEST for action security_group_members [ 658.804445] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9c2bf07-cd28-4135-994d-30a9140bcc35 with Priority: HIGHEST for action security_group_members [ 658.804937] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9c2bf07-cd28-4135-994d-30a9140bcc35 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.804937] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9c2bf07-cd28-4135-994d-30a9140bcc35" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.805120] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9c2bf07-cd28-4135-994d-30a9140bcc35" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.805343] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9c2bf07-cd28-4135-994d-30a9140bcc35" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.805478] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.805616] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.805655] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.805856] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.805912] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.805977] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9c2bf07-cd28-4135-994d-30a9140bcc35',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.844932] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e62e528-352b-40bb-8f9d-c7bb50b75dff in Status: SUCCESS [ 658.845182] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e62e528-352b-40bb-8f9d-c7bb50b75dff deletion is rescheduled due to dependency. [ 658.845763] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e62e528-352b-40bb-8f9d-c7bb50b75dff" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.869664] env[70764]: INFO networking_nsxv3.common.synchronization [req-2b4e558a-baa9-484b-aa92-aeef41b4d6bc req-53432d2c-8a7c-4248-949a-bf54a2329034 tempest-SecurityGroupRulesNegativeTestJSON-1206504517 tempest-SecurityGroupRulesNegativeTestJSON-1206504517-project-member] Enqueued Resource ID: 30955625-17e0-4432-9f75-c03821b0d10d with Priority: HIGHEST for action security_group_rules [ 658.870354] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30955625-17e0-4432-9f75-c03821b0d10d with Priority: HIGHEST for action security_group_rules [ 658.870354] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30955625-17e0-4432-9f75-c03821b0d10d taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.870354] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30955625-17e0-4432-9f75-c03821b0d10d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.870354] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30955625-17e0-4432-9f75-c03821b0d10d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.870605] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30955625-17e0-4432-9f75-c03821b0d10d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.870701] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30955625-17e0-4432-9f75-c03821b0d10d',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.881593] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.882746] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('18c40e3b-51cd-431a-858a-22168889b4fd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.906698] env[70764]: INFO networking_nsxv3.common.synchronization [req-4e040267-c0b9-4b81-b5e3-6770795bd61c req-c33ba729-717d-437e-a2be-2de5f2e89a26 service nova] Enqueued Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_rules [ 658.906698] env[70764]: INFO networking_nsxv3.common.synchronization [req-4e040267-c0b9-4b81-b5e3-6770795bd61c req-c33ba729-717d-437e-a2be-2de5f2e89a26 service nova] Enqueued Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_members [ 658.906958] env[70764]: INFO networking_nsxv3.common.synchronization [req-4e040267-c0b9-4b81-b5e3-6770795bd61c req-c33ba729-717d-437e-a2be-2de5f2e89a26 service nova] Enqueued Resource ID: a5b985ab-b183-4f58-a1a8-c0e3bdf6c096 with Priority: HIGHEST for action port [ 658.907414] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_rules [ 658.907480] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_members [ 658.907575] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5b985ab-b183-4f58-a1a8-c0e3bdf6c096 with Priority: HIGHEST for action port [ 658.909299] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.909299] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.909299] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.909299] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.910043] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.911271] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.911454] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.911556] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.911691] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.911860] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.911980] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.912084] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.912240] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.912329] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.912408] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.913578] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5b985ab-b183-4f58-a1a8-c0e3bdf6c096 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.913901] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5b985ab-b183-4f58-a1a8-c0e3bdf6c096" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.913901] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5b985ab-b183-4f58-a1a8-c0e3bdf6c096" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.913901] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5b985ab-b183-4f58-a1a8-c0e3bdf6c096" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.914230] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5b985ab-b183-4f58-a1a8-c0e3bdf6c096',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.134813] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('380030c5-e260-46fb-aa7e-5000c5bc9507',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.143736] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e9c0048-237b-4cab-86e0-e56dce546daa in Status: SUCCESS [ 659.143956] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.144213] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.144407] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.144602] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.144727] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.144794] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.144943] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.145037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.145150] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.145270] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e9c0048-237b-4cab-86e0-e56dce546daa taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.145362] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.145420] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.145583] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.145700] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.145790] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.145847] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.145988] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.146143] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.146231] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.146326] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e9c0048-237b-4cab-86e0-e56dce546daa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.310119] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.310404] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.310404] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.310569] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.310656] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.310857] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.311061] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.311138] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.311299] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.311378] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.311996] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9c2bf07-cd28-4135-994d-30a9140bcc35 already deleted. [ 659.311996] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9c2bf07-cd28-4135-994d-30a9140bcc35" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.385088] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.385261] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.385343] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.385556] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.385648] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.385759] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b is going to be updated. [ 659.387105] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.387218] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.387293] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.387460] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.387533] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.387619] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18c40e3b-51cd-431a-858a-22168889b4fd is going to be created. [ 659.392194] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.392319] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.392382] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.393301] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.393419] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.393508] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30955625-17e0-4432-9f75-c03821b0d10d already deleted. [ 659.393597] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30955625-17e0-4432-9f75-c03821b0d10d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.416690] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.416917] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.416917] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.417137] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.417285] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.422309] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.422309] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.422309] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.422309] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.422309] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.422309] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.422309] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.422309] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.424766] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a5b985ab-b183-4f58-a1a8-c0e3bdf6c096 with status ACTIVE [ 659.424860] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.425135] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.425135] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.426018] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.426018] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.426018] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.426295] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.426295] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.426383] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.426418] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.426908] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.426908] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.426908] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.427484] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.427484] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.427638] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a5b985ab-b183-4f58-a1a8-c0e3bdf6c096 is going to be updated. [ 659.438034] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b in Status: IN_PROGRESS for 2s [ 659.439060] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18c40e3b-51cd-431a-858a-22168889b4fd in Status: UNINITIALIZED for 2s [ 659.447670] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.447766] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.447862] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.448452] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.448452] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.448528] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5b985ab-b183-4f58-a1a8-c0e3bdf6c096" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.536312] env[70764]: INFO networking_nsxv3.common.synchronization [None req-c2f5e55a-7c89-4c7c-b9c8-514e33387178 None None] Enqueued Resource ID: 9846a386-7121-4c1f-b48a-64473c89a93b with Priority: HIGHEST for action port [ 659.536610] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9846a386-7121-4c1f-b48a-64473c89a93b with Priority: HIGHEST for action port [ 659.541840] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-9846a386-7121-4c1f-b48a-64473c89a93b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.541840] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9846a386-7121-4c1f-b48a-64473c89a93b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.541840] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9846a386-7121-4c1f-b48a-64473c89a93b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.541840] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9846a386-7121-4c1f-b48a-64473c89a93b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.541840] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9846a386-7121-4c1f-b48a-64473c89a93b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.637560] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 380030c5-e260-46fb-aa7e-5000c5bc9507: rpc.has_security_group_logging(os_id): False [ 659.650707] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e9c0048-237b-4cab-86e0-e56dce546daa: rpc.has_security_group_logging(os_id): False [ 659.655153] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.655332] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.655408] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.655664] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.655795] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.656740] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.656740] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.656740] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.656930] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.657022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.657145] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 is going to be created. [ 659.664667] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.665285] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.665285] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.665285] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.665285] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.665566] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.665625] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.665902] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.665902] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.666060] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.666195] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.666327] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.666413] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.666584] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.666689] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.667029] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.667029] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.667202] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.667255] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.667367] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.668075] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e9c0048-237b-4cab-86e0-e56dce546daa is going to be created. [ 659.724034] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.724034] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.724034] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.724034] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.724034] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.724726] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.725137] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.725348] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.725861] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.726190] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.731148] env[70764]: INFO networking_nsxv3.common.synchronization [req-5757612a-de4a-46d4-8793-8cb6851d3999 req-d7ef0093-8d15-4884-a0ff-a824525d2509 tempest-ServerExternalEventsTest-779949483 tempest-ServerExternalEventsTest-779949483-project-member] Enqueued Resource ID: 4bfe698a-a7e8-4922-85ee-f21b719b7edb with Priority: HIGHEST for action security_group_members [ 659.734237] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bfe698a-a7e8-4922-85ee-f21b719b7edb with Priority: HIGHEST for action security_group_members [ 659.734237] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bfe698a-a7e8-4922-85ee-f21b719b7edb taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.734237] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bfe698a-a7e8-4922-85ee-f21b719b7edb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.734237] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bfe698a-a7e8-4922-85ee-f21b719b7edb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.734237] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bfe698a-a7e8-4922-85ee-f21b719b7edb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.734237] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.734237] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.734237] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.734237] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.734237] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.734237] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4bfe698a-a7e8-4922-85ee-f21b719b7edb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.737889] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 in Status: IN_PROGRESS for 2s [ 659.739054] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e9c0048-237b-4cab-86e0-e56dce546daa in Status: IN_PROGRESS for 2s [ 659.800322] env[70764]: INFO networking_nsxv3.common.synchronization [None req-727ab30a-d113-4085-b247-e7a5efd4af9f None None] Enqueued Resource ID: ea3870c5-42cc-4406-a829-fb89600e602b with Priority: HIGHEST for action port [ 659.800322] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea3870c5-42cc-4406-a829-fb89600e602b with Priority: HIGHEST for action port [ 659.800322] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea3870c5-42cc-4406-a829-fb89600e602b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.800322] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea3870c5-42cc-4406-a829-fb89600e602b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.800322] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea3870c5-42cc-4406-a829-fb89600e602b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.801169] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea3870c5-42cc-4406-a829-fb89600e602b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.801657] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea3870c5-42cc-4406-a829-fb89600e602b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.925309] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.047706] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9846a386-7121-4c1f-b48a-64473c89a93b [ 660.050130] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.050130] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.050130] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.050130] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.050130] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.050130] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9846a386-7121-4c1f-b48a-64473c89a93b already deleted. [ 660.054439] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9846a386-7121-4c1f-b48a-64473c89a93b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.238323] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.238717] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.238927] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.239861] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.239861] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.239861] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.239861] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.239861] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.240256] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.240256] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.240256] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bfe698a-a7e8-4922-85ee-f21b719b7edb is going to be updated. [ 660.270616] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.270781] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.270846] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.271180] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.271273] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.280216] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bfe698a-a7e8-4922-85ee-f21b719b7edb in Status: IN_PROGRESS for 2s [ 660.304249] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ea3870c5-42cc-4406-a829-fb89600e602b [ 660.304249] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.304525] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.304525] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.304642] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.304761] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.304867] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ea3870c5-42cc-4406-a829-fb89600e602b already deleted. [ 660.304973] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea3870c5-42cc-4406-a829-fb89600e602b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.403175] env[70764]: INFO networking_nsxv3.common.synchronization [req-368e1468-29a6-4be7-8308-332bccbf6ee9 req-2d4cfda2-8d97-45c6-b2f2-0b96870142a6 tempest-SecurityGroupRulesTestJSON-86292721 tempest-SecurityGroupRulesTestJSON-86292721-project-member] Enqueued Resource ID: def4df50-283e-46b1-aeeb-3e9c8ffc76de with Priority: HIGHEST for action security_group_rules [ 660.404168] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: def4df50-283e-46b1-aeeb-3e9c8ffc76de with Priority: HIGHEST for action security_group_rules [ 660.404416] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-def4df50-283e-46b1-aeeb-3e9c8ffc76de taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.404541] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-def4df50-283e-46b1-aeeb-3e9c8ffc76de" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.404748] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-def4df50-283e-46b1-aeeb-3e9c8ffc76de" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.404955] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-def4df50-283e-46b1-aeeb-3e9c8ffc76de" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.405053] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('def4df50-283e-46b1-aeeb-3e9c8ffc76de',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.427498] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-343 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.427657] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-343" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.427775] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-343" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.428113] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-343" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.428377] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.428532] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.428643] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.428851] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.428996] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.429662] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 660.429778] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 660.429888] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 660.430029] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 660.430150] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 660.430262] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 660.430389] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 660.432127] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.432253] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.432322] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.432755] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.432859] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.432953] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8f5efec-a14e-4be6-8add-7b35a995c982 is going to be created. [ 660.455834] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 660.456094] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 660.457822] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 660.457822] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-343" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.457822] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-c7e09f89-7534-4684-bbab-d8fb60b66970 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.457822] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-c7e09f89-7534-4684-bbab-d8fb60b66970" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.457822] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-c7e09f89-7534-4684-bbab-d8fb60b66970" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.457822] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-c7e09f89-7534-4684-bbab-d8fb60b66970" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.457822] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7e09f89-7534-4684-bbab-d8fb60b66970',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.463324] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.463324] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.463324] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.463324] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.463324] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.472259] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: UNINITIALIZED for 2s [ 660.926241] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.926241] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.926241] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.926241] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.926241] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.926241] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: def4df50-283e-46b1-aeeb-3e9c8ffc76de already deleted. [ 660.926241] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-def4df50-283e-46b1-aeeb-3e9c8ffc76de" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.962158] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.962158] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.962158] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.962158] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.962158] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.962158] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port c7e09f89-7534-4684-bbab-d8fb60b66970 not found, creating... [ 660.962158] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.963631] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.964053] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.964568] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.964972] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.967021] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.967021] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.967021] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.967021] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.967021] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.967021] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: c7e09f89-7534-4684-bbab-d8fb60b66970 is going to be created. [ 660.990022] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.990022] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.990022] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.990022] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.990022] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.990022] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-c7e09f89-7534-4684-bbab-d8fb60b66970" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.453021] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b in Status: SUCCESS [ 661.453021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.453021] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18c40e3b-51cd-431a-858a-22168889b4fd in Status: SUCCESS [ 661.453021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18c40e3b-51cd-431a-858a-22168889b4fd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.453021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.453021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.453021] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.453021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.453021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.453021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.453021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.453021] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.453021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18c40e3b-51cd-431a-858a-22168889b4fd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.453983] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18c40e3b-51cd-431a-858a-22168889b4fd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.454288] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.454515] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.454681] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.454907] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.455097] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.455364] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18c40e3b-51cd-431a-858a-22168889b4fd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.475317] env[70764]: INFO networking_nsxv3.common.synchronization [req-d4d77fff-4dd7-445a-95ce-f7d90cb4b43e req-c553b0b8-aeb7-45a8-84b8-326cc54566a2 tempest-SecurityGroupsTestJSON-512195178 tempest-SecurityGroupsTestJSON-512195178-project-member] Enqueued Resource ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b with Priority: HIGHEST for action security_group_members [ 661.475317] env[70764]: INFO networking_nsxv3.common.synchronization [req-d4d77fff-4dd7-445a-95ce-f7d90cb4b43e req-c553b0b8-aeb7-45a8-84b8-326cc54566a2 tempest-SecurityGroupsTestJSON-512195178 tempest-SecurityGroupsTestJSON-512195178-project-member] Enqueued Resource ID: fdc56614-fc86-49b5-b218-5339e368633a with Priority: HIGHEST for action security_group_members [ 661.475317] env[70764]: INFO networking_nsxv3.common.synchronization [req-d4d77fff-4dd7-445a-95ce-f7d90cb4b43e req-c553b0b8-aeb7-45a8-84b8-326cc54566a2 tempest-SecurityGroupsTestJSON-512195178 tempest-SecurityGroupsTestJSON-512195178-project-member] Enqueued Resource ID: 18c40e3b-51cd-431a-858a-22168889b4fd with Priority: HIGHEST for action security_group_members [ 661.475317] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b with Priority: HIGHEST for action security_group_members [ 661.475317] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdc56614-fc86-49b5-b218-5339e368633a with Priority: HIGHEST for action security_group_members [ 661.475317] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18c40e3b-51cd-431a-858a-22168889b4fd with Priority: HIGHEST for action security_group_members [ 661.475317] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.476036] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.476372] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdc56614-fc86-49b5-b218-5339e368633a taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.476609] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdc56614-fc86-49b5-b218-5339e368633a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.476785] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdc56614-fc86-49b5-b218-5339e368633a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.477149] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdc56614-fc86-49b5-b218-5339e368633a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.477412] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.477623] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.477773] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.478033] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.478210] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.478389] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdc56614-fc86-49b5-b218-5339e368633a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.479869] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-18c40e3b-51cd-431a-858a-22168889b4fd taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.480148] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18c40e3b-51cd-431a-858a-22168889b4fd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.611394] env[70764]: INFO networking_nsxv3.common.synchronization [req-d4d77fff-4dd7-445a-95ce-f7d90cb4b43e req-c553b0b8-aeb7-45a8-84b8-326cc54566a2 tempest-SecurityGroupsTestJSON-512195178 tempest-SecurityGroupsTestJSON-512195178-project-member] Enqueued Resource ID: 18c40e3b-51cd-431a-858a-22168889b4fd with Priority: HIGHEST for action security_group_rules [ 661.612989] env[70764]: INFO networking_nsxv3.common.synchronization [req-d4d77fff-4dd7-445a-95ce-f7d90cb4b43e req-c553b0b8-aeb7-45a8-84b8-326cc54566a2 tempest-SecurityGroupsTestJSON-512195178 tempest-SecurityGroupsTestJSON-512195178-project-member] Enqueued Resource ID: 18c40e3b-51cd-431a-858a-22168889b4fd with Priority: HIGHEST for action security_group_members [ 661.616142] env[70764]: INFO networking_nsxv3.common.synchronization [req-d4d77fff-4dd7-445a-95ce-f7d90cb4b43e req-c553b0b8-aeb7-45a8-84b8-326cc54566a2 tempest-SecurityGroupsTestJSON-512195178 tempest-SecurityGroupsTestJSON-512195178-project-member] Enqueued Resource ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b with Priority: HIGHEST for action security_group_rules [ 661.616142] env[70764]: INFO networking_nsxv3.common.synchronization [req-d4d77fff-4dd7-445a-95ce-f7d90cb4b43e req-c553b0b8-aeb7-45a8-84b8-326cc54566a2 tempest-SecurityGroupsTestJSON-512195178 tempest-SecurityGroupsTestJSON-512195178-project-member] Enqueued Resource ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b with Priority: HIGHEST for action security_group_members [ 661.616142] env[70764]: INFO networking_nsxv3.common.synchronization [req-d4d77fff-4dd7-445a-95ce-f7d90cb4b43e req-c553b0b8-aeb7-45a8-84b8-326cc54566a2 tempest-SecurityGroupsTestJSON-512195178 tempest-SecurityGroupsTestJSON-512195178-project-member] Enqueued Resource ID: fdc56614-fc86-49b5-b218-5339e368633a with Priority: HIGHEST for action security_group_rules [ 661.616142] env[70764]: INFO networking_nsxv3.common.synchronization [req-d4d77fff-4dd7-445a-95ce-f7d90cb4b43e req-c553b0b8-aeb7-45a8-84b8-326cc54566a2 tempest-SecurityGroupsTestJSON-512195178 tempest-SecurityGroupsTestJSON-512195178-project-member] Enqueued Resource ID: fdc56614-fc86-49b5-b218-5339e368633a with Priority: HIGHEST for action security_group_members [ 661.616142] env[70764]: INFO networking_nsxv3.common.synchronization [req-d4d77fff-4dd7-445a-95ce-f7d90cb4b43e req-c553b0b8-aeb7-45a8-84b8-326cc54566a2 tempest-SecurityGroupsTestJSON-512195178 tempest-SecurityGroupsTestJSON-512195178-project-member] Enqueued Resource ID: c2694d3f-527f-4890-bf9d-62a74f11b251 with Priority: HIGHEST for action port [ 661.617059] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18c40e3b-51cd-431a-858a-22168889b4fd with Priority: HIGHEST for action security_group_rules [ 661.617318] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b with Priority: HIGHEST for action security_group_rules [ 661.617717] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdc56614-fc86-49b5-b218-5339e368633a with Priority: HIGHEST for action security_group_members [ 661.618046] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2694d3f-527f-4890-bf9d-62a74f11b251 with Priority: HIGHEST for action port [ 661.618274] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdc56614-fc86-49b5-b218-5339e368633a with Priority: HIGHEST for action security_group_rules [ 661.618464] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18c40e3b-51cd-431a-858a-22168889b4fd with Priority: HIGHEST for action security_group_members [ 661.618643] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b with Priority: HIGHEST for action security_group_members [ 661.620067] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18c40e3b-51cd-431a-858a-22168889b4fd taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.620946] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18c40e3b-51cd-431a-858a-22168889b4fd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.622018] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c2d79e00-b6b0-41f3-96fb-49ab2b10751b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.622018] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.622018] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdc56614-fc86-49b5-b218-5339e368633a taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.622018] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdc56614-fc86-49b5-b218-5339e368633a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.622018] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2694d3f-527f-4890-bf9d-62a74f11b251 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.622018] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2694d3f-527f-4890-bf9d-62a74f11b251" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.622018] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2694d3f-527f-4890-bf9d-62a74f11b251" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.623304] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2694d3f-527f-4890-bf9d-62a74f11b251" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.623490] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2694d3f-527f-4890-bf9d-62a74f11b251',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.624623] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fdc56614-fc86-49b5-b218-5339e368633a taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.624880] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fdc56614-fc86-49b5-b218-5339e368633a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.631022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fdc56614-fc86-49b5-b218-5339e368633a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.631022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fdc56614-fc86-49b5-b218-5339e368633a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.631022] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fdc56614-fc86-49b5-b218-5339e368633a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.631022] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-18c40e3b-51cd-431a-858a-22168889b4fd taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.631022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18c40e3b-51cd-431a-858a-22168889b4fd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.631920] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.632163] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.752565] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 in Status: SUCCESS [ 661.752789] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.753627] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e9c0048-237b-4cab-86e0-e56dce546daa in Status: SUCCESS [ 661.753833] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.754017] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.754398] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.754473] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e9c0048-237b-4cab-86e0-e56dce546daa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.865071] env[70764]: INFO networking_nsxv3.common.synchronization [req-c1802fc1-3fc1-46aa-b1ab-fa20adda399e req-7e5ef041-68ba-488d-81a3-1ffa486fd968 service nova] Enqueued Resource ID: f9c2bf07-cd28-4135-994d-30a9140bcc35 with Priority: HIGHEST for action security_group_rules [ 661.865256] env[70764]: INFO networking_nsxv3.common.synchronization [req-c1802fc1-3fc1-46aa-b1ab-fa20adda399e req-7e5ef041-68ba-488d-81a3-1ffa486fd968 service nova] Enqueued Resource ID: f9c2bf07-cd28-4135-994d-30a9140bcc35 with Priority: HIGHEST for action security_group_members [ 661.865393] env[70764]: INFO networking_nsxv3.common.synchronization [req-c1802fc1-3fc1-46aa-b1ab-fa20adda399e req-7e5ef041-68ba-488d-81a3-1ffa486fd968 service nova] Enqueued Resource ID: c7e09f89-7534-4684-bbab-d8fb60b66970 with Priority: HIGHEST for action port [ 661.865670] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9c2bf07-cd28-4135-994d-30a9140bcc35 with Priority: HIGHEST for action security_group_rules [ 661.865820] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9c2bf07-cd28-4135-994d-30a9140bcc35 with Priority: HIGHEST for action security_group_members [ 661.865924] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7e09f89-7534-4684-bbab-d8fb60b66970 with Priority: HIGHEST for action port [ 661.866493] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9c2bf07-cd28-4135-994d-30a9140bcc35 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.866910] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9c2bf07-cd28-4135-994d-30a9140bcc35" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.867042] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9c2bf07-cd28-4135-994d-30a9140bcc35" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.867352] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9c2bf07-cd28-4135-994d-30a9140bcc35" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.867490] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9c2bf07-cd28-4135-994d-30a9140bcc35',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.868781] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9c2bf07-cd28-4135-994d-30a9140bcc35 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.868936] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9c2bf07-cd28-4135-994d-30a9140bcc35" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.869058] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9c2bf07-cd28-4135-994d-30a9140bcc35" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.869278] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9c2bf07-cd28-4135-994d-30a9140bcc35" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.869481] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.869631] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.869741] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.870099] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.870174] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.870326] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9c2bf07-cd28-4135-994d-30a9140bcc35',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.872476] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-c7e09f89-7534-4684-bbab-d8fb60b66970 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.872600] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c7e09f89-7534-4684-bbab-d8fb60b66970" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.872669] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c7e09f89-7534-4684-bbab-d8fb60b66970" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.872826] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c7e09f89-7534-4684-bbab-d8fb60b66970" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.872903] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7e09f89-7534-4684-bbab-d8fb60b66970',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.957785] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.958612] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('18c40e3b-51cd-431a-858a-22168889b4fd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.981633] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fdc56614-fc86-49b5-b218-5339e368633a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.133624] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c2694d3f-527f-4890-bf9d-62a74f11b251 with status ACTIVE [ 662.133862] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.134026] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.136476] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.136765] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.136907] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.137143] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.137257] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.137323] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.137479] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.137587] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.137735] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.137870] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.137917] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.138100] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.138132] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.138306] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c2694d3f-527f-4890-bf9d-62a74f11b251 is going to be updated. [ 662.139862] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdc56614-fc86-49b5-b218-5339e368633a taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.139978] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdc56614-fc86-49b5-b218-5339e368633a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.161635] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.161793] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.161864] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.162095] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.162247] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.162409] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2694d3f-527f-4890-bf9d-62a74f11b251" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.238900] env[70764]: INFO networking_nsxv3.common.synchronization [None req-6408cc6b-e456-4673-a8ba-2ffe34faad9d tempest-ServersV294TestFqdnHostnames-288623823 tempest-ServersV294TestFqdnHostnames-288623823-project-member] Enqueued Resource ID: c0695687-32e8-4e4a-a8c8-31e6c3709596 with Priority: HIGHEST for action security_group_rules [ 662.238900] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0695687-32e8-4e4a-a8c8-31e6c3709596 with Priority: HIGHEST for action security_group_rules [ 662.238900] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0695687-32e8-4e4a-a8c8-31e6c3709596 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.239606] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0695687-32e8-4e4a-a8c8-31e6c3709596" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.239948] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0695687-32e8-4e4a-a8c8-31e6c3709596" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.240387] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0695687-32e8-4e4a-a8c8-31e6c3709596" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.240727] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0695687-32e8-4e4a-a8c8-31e6c3709596',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.258480] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e9c0048-237b-4cab-86e0-e56dce546daa taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.258581] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.258630] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.258856] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.259049] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.259164] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.259246] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.259428] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.259512] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.259600] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.259688] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e9c0048-237b-4cab-86e0-e56dce546daa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.295334] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bfe698a-a7e8-4922-85ee-f21b719b7edb in Status: SUCCESS [ 662.295556] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bfe698a-a7e8-4922-85ee-f21b719b7edb deletion is rescheduled due to dependency. [ 662.295663] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bfe698a-a7e8-4922-85ee-f21b719b7edb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.369528] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9c2bf07-cd28-4135-994d-30a9140bcc35 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.369729] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9c2bf07-cd28-4135-994d-30a9140bcc35" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.373107] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f9c2bf07-cd28-4135-994d-30a9140bcc35',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.374647] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c7e09f89-7534-4684-bbab-d8fb60b66970 with status ACTIVE [ 662.374917] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.375081] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.375176] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.375526] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.375621] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.375819] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.375908] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.375987] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.376139] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.376208] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.376388] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.376482] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.376574] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.376726] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.376794] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.376902] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c7e09f89-7534-4684-bbab-d8fb60b66970 is going to be updated. [ 662.408216] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.408361] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.408531] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.408648] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.408787] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.408990] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c7e09f89-7534-4684-bbab-d8fb60b66970" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.460266] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.464559] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('18c40e3b-51cd-431a-858a-22168889b4fd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.481799] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: SUCCESS [ 662.482037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.482205] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.482421] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.482615] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.482731] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.482794] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.482947] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.483041] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.483216] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.483216] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.485927] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fdc56614-fc86-49b5-b218-5339e368633a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.548891] env[70764]: INFO networking_nsxv3.common.synchronization [None req-56152783-b38b-44cf-a92a-568858ae75b9 tempest-ServersV294TestFqdnHostnames-288623823 tempest-ServersV294TestFqdnHostnames-288623823-project-member] Enqueued Resource ID: c0695687-32e8-4e4a-a8c8-31e6c3709596 with Priority: HIGHEST for action security_group_rules [ 662.548891] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0695687-32e8-4e4a-a8c8-31e6c3709596 with Priority: HIGHEST for action security_group_rules [ 662.549608] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0695687-32e8-4e4a-a8c8-31e6c3709596 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.549766] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0695687-32e8-4e4a-a8c8-31e6c3709596" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.760231] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.760231] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.760231] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.760231] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.760231] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.760231] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0695687-32e8-4e4a-a8c8-31e6c3709596 already deleted. [ 662.760578] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0695687-32e8-4e4a-a8c8-31e6c3709596" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.760879] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0695687-32e8-4e4a-a8c8-31e6c3709596" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.761149] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0695687-32e8-4e4a-a8c8-31e6c3709596" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.761304] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0695687-32e8-4e4a-a8c8-31e6c3709596',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.762725] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e9c0048-237b-4cab-86e0-e56dce546daa taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.762844] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.762910] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.763080] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.763387] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.763498] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.763560] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.763706] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.763785] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.763866] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.764047] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e9c0048-237b-4cab-86e0-e56dce546daa taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.764164] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.764808] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.764808] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.764808] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.764808] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.764808] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.764808] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.765071] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.765071] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.765071] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e9c0048-237b-4cab-86e0-e56dce546daa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.824021] env[70764]: INFO networking_nsxv3.common.synchronization [None req-50e6bafe-c16d-44b7-841b-92ae0a5865cb None None] Enqueued Resource ID: 425c5351-d351-4ecb-9b0c-b89af85664b9 with Priority: HIGHEST for action port [ 662.824652] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 425c5351-d351-4ecb-9b0c-b89af85664b9 with Priority: HIGHEST for action port [ 662.825154] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-425c5351-d351-4ecb-9b0c-b89af85664b9 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.825393] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-425c5351-d351-4ecb-9b0c-b89af85664b9" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.825544] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-425c5351-d351-4ecb-9b0c-b89af85664b9" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.825873] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-425c5351-d351-4ecb-9b0c-b89af85664b9" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.826078] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('425c5351-d351-4ecb-9b0c-b89af85664b9',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.878023] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f9c2bf07-cd28-4135-994d-30a9140bcc35',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.963132] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.963687] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.964142] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.964574] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.966896] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.966896] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b is going to be updated. [ 662.970204] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.970204] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.970204] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.970204] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.970204] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.970204] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18c40e3b-51cd-431a-858a-22168889b4fd is going to be updated. [ 662.988397] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.988397] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.988397] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.988397] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.988397] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.988397] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.988397] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.988397] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.988397] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.988397] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.988397] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.988397] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.988397] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.988397] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.988397] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.988397] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.988962] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.988962] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.988962] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.988962] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.988962] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.993551] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.993685] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.993728] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.994277] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.994277] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.995589] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.995725] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.995785] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.995915] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.996769] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.997449] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.997564] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.997624] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.997778] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.997856] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.997946] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdc56614-fc86-49b5-b218-5339e368633a is going to be created. [ 663.007589] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18c40e3b-51cd-431a-858a-22168889b4fd in Status: IN_PROGRESS for 2s [ 663.008263] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b in Status: IN_PROGRESS for 2s [ 663.056284] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.056284] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.056284] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.056284] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.056284] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.070212] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdc56614-fc86-49b5-b218-5339e368633a in Status: UNINITIALIZED for 2s [ 663.197838] env[70764]: INFO networking_nsxv3.common.synchronization [req-64a56236-1fa3-46fd-95ed-46cd809b48bf req-dc78b3c5-1563-40d0-8bcf-0afc67df1a3c tempest-ServerAddressesTestJSON-199602658 tempest-ServerAddressesTestJSON-199602658-project-member] Enqueued Resource ID: 82966c1e-4055-4b82-8cb6-2f08a28fcec0 with Priority: HIGHEST for action security_group_members [ 663.198100] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82966c1e-4055-4b82-8cb6-2f08a28fcec0 with Priority: HIGHEST for action security_group_members [ 663.198714] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-82966c1e-4055-4b82-8cb6-2f08a28fcec0 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.198850] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82966c1e-4055-4b82-8cb6-2f08a28fcec0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.198915] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82966c1e-4055-4b82-8cb6-2f08a28fcec0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.201591] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82966c1e-4055-4b82-8cb6-2f08a28fcec0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.201591] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.201591] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.201591] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.201591] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.201591] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.201591] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82966c1e-4055-4b82-8cb6-2f08a28fcec0',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.271466] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e9c0048-237b-4cab-86e0-e56dce546daa: rpc.has_security_group_logging(os_id): False [ 663.284617] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.285041] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.285115] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.285338] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.285433] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.285527] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0695687-32e8-4e4a-a8c8-31e6c3709596 already deleted. [ 663.285609] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0695687-32e8-4e4a-a8c8-31e6c3709596" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.294894] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.294894] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.294894] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.294894] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.294894] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.294894] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.294894] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.294894] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.294894] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.294894] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.294894] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.294894] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.294894] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.294894] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.294894] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.296646] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.296646] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.296646] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.296646] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.296646] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.296646] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e9c0048-237b-4cab-86e0-e56dce546daa is going to be updated. [ 663.330459] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 425c5351-d351-4ecb-9b0c-b89af85664b9 [ 663.331059] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.331059] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.331059] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.331227] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.331227] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.332201] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:425c5351-d351-4ecb-9b0c-b89af85664b9 already deleted. [ 663.332201] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-425c5351-d351-4ecb-9b0c-b89af85664b9" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.376650] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.376650] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.376650] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.376808] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.376940] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.379659] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.379789] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.379853] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.380093] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.380193] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.380289] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9c2bf07-cd28-4135-994d-30a9140bcc35 is going to be created. [ 663.393605] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e9c0048-237b-4cab-86e0-e56dce546daa in Status: IN_PROGRESS for 2s [ 663.405162] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.405264] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.405344] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.405598] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.405713] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.415237] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9c2bf07-cd28-4135-994d-30a9140bcc35 in Status: UNINITIALIZED for 2s [ 663.493963] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f8f5efec-a14e-4be6-8add-7b35a995c982: rpc.has_security_group_logging(os_id): False [ 663.514852] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.515035] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.515035] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.515215] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.515259] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.515451] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.515584] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.515623] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.515771] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.515827] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.516101] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.516243] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.516275] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.516407] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.516481] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.516658] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.516752] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.516811] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.516948] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.517722] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.517908] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8f5efec-a14e-4be6-8add-7b35a995c982 is going to be created. [ 663.581653] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.582746] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.582871] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.583058] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.583243] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.593607] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: IN_PROGRESS for 2s [ 663.705022] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.705098] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.705233] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.705384] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.705475] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.705673] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.705780] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.705857] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.705977] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.706066] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.706149] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82966c1e-4055-4b82-8cb6-2f08a28fcec0 already deleted. [ 663.706229] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82966c1e-4055-4b82-8cb6-2f08a28fcec0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.791201] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-507 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.791915] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.792182] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.792731] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.793484] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.793602] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.793831] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.794337] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.794623] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.795028] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 663.795215] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 663.795441] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 663.795655] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 663.795949] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 663.796510] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 663.796510] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 663.817816] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 663.817816] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 663.817816] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 663.817816] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.817816] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-f63533b8-fb2e-44d0-a6d1-65d0c4be4b33 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.817816] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-f63533b8-fb2e-44d0-a6d1-65d0c4be4b33" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.817816] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-f63533b8-fb2e-44d0-a6d1-65d0c4be4b33" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.817816] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-f63533b8-fb2e-44d0-a6d1-65d0c4be4b33" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.817816] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f63533b8-fb2e-44d0-a6d1-65d0c4be4b33',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.322792] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.323042] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.323171] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.323614] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.323614] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.323761] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port f63533b8-fb2e-44d0-a6d1-65d0c4be4b33 not found, creating... [ 664.324030] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.324188] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.324298] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.324521] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.324674] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.325235] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.325235] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.325235] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.325710] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.325710] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.325710] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: f63533b8-fb2e-44d0-a6d1-65d0c4be4b33 is going to be created. [ 664.344829] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.345181] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.345379] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.345838] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.346180] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.346470] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-f63533b8-fb2e-44d0-a6d1-65d0c4be4b33" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.387804] env[70764]: INFO networking_nsxv3.common.synchronization [req-05c3a40b-a6ea-4837-8fa1-f51d56d8a03a req-03f0d8cb-d212-420a-a0d4-1b1e0c863431 tempest-SecurityGroupRulesNegativeTestJSON-1206504517 tempest-SecurityGroupRulesNegativeTestJSON-1206504517-project-member] Enqueued Resource ID: 30955625-17e0-4432-9f75-c03821b0d10d with Priority: HIGHEST for action security_group_rules [ 664.388424] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30955625-17e0-4432-9f75-c03821b0d10d with Priority: HIGHEST for action security_group_rules [ 664.388745] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30955625-17e0-4432-9f75-c03821b0d10d taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.388874] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30955625-17e0-4432-9f75-c03821b0d10d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.388942] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30955625-17e0-4432-9f75-c03821b0d10d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.391094] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30955625-17e0-4432-9f75-c03821b0d10d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.391194] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30955625-17e0-4432-9f75-c03821b0d10d',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.912054] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.912395] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.913480] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.913817] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.913995] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.914178] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30955625-17e0-4432-9f75-c03821b0d10d already deleted. [ 664.914260] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30955625-17e0-4432-9f75-c03821b0d10d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.018895] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18c40e3b-51cd-431a-858a-22168889b4fd in Status: SUCCESS [ 665.019205] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18c40e3b-51cd-431a-858a-22168889b4fd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.019905] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b in Status: SUCCESS [ 665.020176] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.020372] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18c40e3b-51cd-431a-858a-22168889b4fd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.020673] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18c40e3b-51cd-431a-858a-22168889b4fd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.021178] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.021382] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.021488] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.021700] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.021828] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.022202] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18c40e3b-51cd-431a-858a-22168889b4fd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.022417] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('18c40e3b-51cd-431a-858a-22168889b4fd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.024193] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.024810] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.028066] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.028211] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.028375] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.028442] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.028516] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.028602] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.028699] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.030143] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18c40e3b-51cd-431a-858a-22168889b4fd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.030316] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18c40e3b-51cd-431a-858a-22168889b4fd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.030478] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.030580] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.030645] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.030795] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.030875] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.030960] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18c40e3b-51cd-431a-858a-22168889b4fd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.032199] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.032447] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.032796] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.032914] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.032983] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.033354] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.033487] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.033627] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.077761] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdc56614-fc86-49b5-b218-5339e368633a in Status: SUCCESS [ 665.078039] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdc56614-fc86-49b5-b218-5339e368633a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.078284] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdc56614-fc86-49b5-b218-5339e368633a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.078500] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdc56614-fc86-49b5-b218-5339e368633a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.078686] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.078809] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.078877] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.079039] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.079124] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.079217] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdc56614-fc86-49b5-b218-5339e368633a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.406885] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e9c0048-237b-4cab-86e0-e56dce546daa in Status: SUCCESS [ 665.407173] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.423887] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9c2bf07-cd28-4135-994d-30a9140bcc35 in Status: SUCCESS [ 665.424686] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9c2bf07-cd28-4135-994d-30a9140bcc35" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.425677] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9c2bf07-cd28-4135-994d-30a9140bcc35" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.426061] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9c2bf07-cd28-4135-994d-30a9140bcc35" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.426458] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.427181] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.427181] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.427425] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.427586] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.427651] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9c2bf07-cd28-4135-994d-30a9140bcc35" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.427953] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f9c2bf07-cd28-4135-994d-30a9140bcc35',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.444315] env[70764]: INFO networking_nsxv3.common.synchronization [req-64a56236-1fa3-46fd-95ed-46cd809b48bf req-a0a693b6-b381-42aa-95bc-c2348f41dac0 service nova] Enqueued Resource ID: 82966c1e-4055-4b82-8cb6-2f08a28fcec0 with Priority: HIGHEST for action security_group_rules [ 665.444315] env[70764]: INFO networking_nsxv3.common.synchronization [req-64a56236-1fa3-46fd-95ed-46cd809b48bf req-a0a693b6-b381-42aa-95bc-c2348f41dac0 service nova] Enqueued Resource ID: 82966c1e-4055-4b82-8cb6-2f08a28fcec0 with Priority: HIGHEST for action security_group_members [ 665.444494] env[70764]: INFO networking_nsxv3.common.synchronization [req-64a56236-1fa3-46fd-95ed-46cd809b48bf req-a0a693b6-b381-42aa-95bc-c2348f41dac0 service nova] Enqueued Resource ID: f63533b8-fb2e-44d0-a6d1-65d0c4be4b33 with Priority: HIGHEST for action port [ 665.444916] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82966c1e-4055-4b82-8cb6-2f08a28fcec0 with Priority: HIGHEST for action security_group_rules [ 665.444916] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82966c1e-4055-4b82-8cb6-2f08a28fcec0 with Priority: HIGHEST for action security_group_members [ 665.444916] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f63533b8-fb2e-44d0-a6d1-65d0c4be4b33 with Priority: HIGHEST for action port [ 665.445565] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-82966c1e-4055-4b82-8cb6-2f08a28fcec0 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.445693] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-82966c1e-4055-4b82-8cb6-2f08a28fcec0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.445811] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-82966c1e-4055-4b82-8cb6-2f08a28fcec0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.450855] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-82966c1e-4055-4b82-8cb6-2f08a28fcec0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.450855] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('82966c1e-4055-4b82-8cb6-2f08a28fcec0',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.451292] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-82966c1e-4055-4b82-8cb6-2f08a28fcec0 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.452130] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82966c1e-4055-4b82-8cb6-2f08a28fcec0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.452130] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82966c1e-4055-4b82-8cb6-2f08a28fcec0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.452130] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82966c1e-4055-4b82-8cb6-2f08a28fcec0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.452130] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.452130] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.452130] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.452384] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.452384] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.452384] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82966c1e-4055-4b82-8cb6-2f08a28fcec0',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.453653] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-f63533b8-fb2e-44d0-a6d1-65d0c4be4b33 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.453767] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f63533b8-fb2e-44d0-a6d1-65d0c4be4b33" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.453836] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f63533b8-fb2e-44d0-a6d1-65d0c4be4b33" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.454013] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f63533b8-fb2e-44d0-a6d1-65d0c4be4b33" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.458095] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f63533b8-fb2e-44d0-a6d1-65d0c4be4b33',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.526595] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('18c40e3b-51cd-431a-858a-22168889b4fd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.531637] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.533214] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.535749] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.537461] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('18c40e3b-51cd-431a-858a-22168889b4fd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.582037] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fdc56614-fc86-49b5-b218-5339e368633a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.605305] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: SUCCESS [ 665.605579] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.750295] env[70764]: INFO networking_nsxv3.common.synchronization [req-94839514-1292-45ed-880d-4857b4840096 req-92fc053f-11a4-4b9f-a02f-883abcc8684a tempest-AttachInterfacesUnderV243Test-1674775708 tempest-AttachInterfacesUnderV243Test-1674775708-project-member] Enqueued Resource ID: 83d2b431-6671-4f07-b09d-39da26e77cad with Priority: HIGHEST for action security_group_members [ 665.752788] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83d2b431-6671-4f07-b09d-39da26e77cad with Priority: HIGHEST for action security_group_members [ 665.754135] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-83d2b431-6671-4f07-b09d-39da26e77cad taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.754308] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.754353] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.754617] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.755171] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.755299] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.755369] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.755582] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.755691] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.755805] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83d2b431-6671-4f07-b09d-39da26e77cad',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.933096] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9c2bf07-cd28-4135-994d-30a9140bcc35 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.933517] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9c2bf07-cd28-4135-994d-30a9140bcc35" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.933517] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9c2bf07-cd28-4135-994d-30a9140bcc35" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.933679] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9c2bf07-cd28-4135-994d-30a9140bcc35" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.933889] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.934065] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.934119] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.934264] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.934357] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.934442] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9c2bf07-cd28-4135-994d-30a9140bcc35" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.934649] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9c2bf07-cd28-4135-994d-30a9140bcc35 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.934824] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9c2bf07-cd28-4135-994d-30a9140bcc35" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.934902] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9c2bf07-cd28-4135-994d-30a9140bcc35" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.935099] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9c2bf07-cd28-4135-994d-30a9140bcc35" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.935276] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.935387] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.935454] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.935591] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.935673] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.935774] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9c2bf07-cd28-4135-994d-30a9140bcc35" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.935883] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f9c2bf07-cd28-4135-994d-30a9140bcc35',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.960386] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('82966c1e-4055-4b82-8cb6-2f08a28fcec0',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.964633] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-82966c1e-4055-4b82-8cb6-2f08a28fcec0 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.964633] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82966c1e-4055-4b82-8cb6-2f08a28fcec0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.964633] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f63533b8-fb2e-44d0-a6d1-65d0c4be4b33 with status ACTIVE [ 665.964633] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.964633] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.964633] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.964633] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.964633] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.964633] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.964633] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.964633] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.965208] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.965208] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.965208] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.965455] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.965455] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.965743] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.965824] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.965854] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f63533b8-fb2e-44d0-a6d1-65d0c4be4b33 is going to be updated. [ 665.986608] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.986884] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.986884] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.987111] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.987289] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.987400] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f63533b8-fb2e-44d0-a6d1-65d0c4be4b33" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.028157] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 18c40e3b-51cd-431a-858a-22168889b4fd: rpc.has_security_group_logging(os_id): False [ 666.042669] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('18c40e3b-51cd-431a-858a-22168889b4fd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.042782] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.054029] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.054029] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.054029] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.054029] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.054029] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.054029] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.054029] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.054029] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.054029] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.054029] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.054029] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18c40e3b-51cd-431a-858a-22168889b4fd is going to be created. [ 666.088033] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fdc56614-fc86-49b5-b218-5339e368633a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.123730] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.124031] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.124185] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.124519] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.124837] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.153118] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18c40e3b-51cd-431a-858a-22168889b4fd in Status: IN_PROGRESS for 2s [ 666.259326] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.260950] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.261237] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.262114] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.262114] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.262114] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.262330] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.262330] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.262494] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.262889] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.262889] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83d2b431-6671-4f07-b09d-39da26e77cad already deleted. [ 666.262889] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.404379] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-181 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.404535] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-181" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.406018] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-181" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.406018] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-181" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.406018] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.406018] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.406496] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.406851] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.407084] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.408213] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 666.408213] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 666.408213] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 666.408213] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 666.408213] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 666.408482] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 666.408710] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 666.429580] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 666.429789] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 666.429939] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 666.430420] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-181" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.430782] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-d57d3f51-44e0-4cf8-94f1-5ace0266534d taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.430883] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-d57d3f51-44e0-4cf8-94f1-5ace0266534d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.431045] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-d57d3f51-44e0-4cf8-94f1-5ace0266534d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.431489] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-d57d3f51-44e0-4cf8-94f1-5ace0266534d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.431616] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d57d3f51-44e0-4cf8-94f1-5ace0266534d',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.438104] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f9c2bf07-cd28-4135-994d-30a9140bcc35: rpc.has_security_group_logging(os_id): False [ 666.457675] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.461480] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.461566] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.461797] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.461888] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.462132] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.462285] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.462369] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.462553] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.462630] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.462856] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.462953] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.463041] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.463252] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.463327] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.463502] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.463593] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.463653] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.463791] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.463860] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.463949] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9c2bf07-cd28-4135-994d-30a9140bcc35 is going to be created. [ 666.465198] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('82966c1e-4055-4b82-8cb6-2f08a28fcec0',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.522476] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.523274] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.523274] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.523274] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.523274] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.534503] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9c2bf07-cd28-4135-994d-30a9140bcc35 in Status: IN_PROGRESS for 2s [ 666.545953] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.546135] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.546249] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.546462] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.546556] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.546658] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18c40e3b-51cd-431a-858a-22168889b4fd is going to be updated. [ 666.548087] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.548245] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.548316] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.548502] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.548587] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.548679] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b is going to be updated. [ 666.584932] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.584932] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.584932] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.584932] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.584932] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.592957] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.593494] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.593494] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.593567] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.593652] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.595250] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdc56614-fc86-49b5-b218-5339e368633a is going to be updated. [ 666.597306] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.597484] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.597587] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.597809] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.598040] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.599546] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18c40e3b-51cd-431a-858a-22168889b4fd in Status: IN_PROGRESS for 2s [ 666.627226] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b in Status: IN_PROGRESS for 2s [ 666.656810] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.656958] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.657035] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.657321] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.657464] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.670567] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdc56614-fc86-49b5-b218-5339e368633a in Status: IN_PROGRESS for 2s [ 666.934612] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.935013] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.935013] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.935249] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.935393] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.935541] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port d57d3f51-44e0-4cf8-94f1-5ace0266534d not found, creating... [ 666.935802] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.935955] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.936159] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.936309] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.939885] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.939885] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.939885] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.939885] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.939885] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.939885] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.939885] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: d57d3f51-44e0-4cf8-94f1-5ace0266534d is going to be created. [ 666.958115] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.958286] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.958408] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.958670] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.958885] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.959121] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-d57d3f51-44e0-4cf8-94f1-5ace0266534d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.967970] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.968206] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.968316] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.969124] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.969124] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.969124] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82966c1e-4055-4b82-8cb6-2f08a28fcec0 is going to be created. [ 666.994928] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.995694] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.995910] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.996515] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.996858] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.028147] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82966c1e-4055-4b82-8cb6-2f08a28fcec0 in Status: UNINITIALIZED for 2s [ 668.166305] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18c40e3b-51cd-431a-858a-22168889b4fd in Status: SUCCESS [ 668.166305] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18c40e3b-51cd-431a-858a-22168889b4fd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.166305] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18c40e3b-51cd-431a-858a-22168889b4fd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.166305] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18c40e3b-51cd-431a-858a-22168889b4fd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.166664] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18c40e3b-51cd-431a-858a-22168889b4fd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.447199] env[70764]: INFO networking_nsxv3.common.synchronization [req-94839514-1292-45ed-880d-4857b4840096 req-a34e7d26-4c34-42ef-b0af-29a74976f86b service nova] Enqueued Resource ID: 83d2b431-6671-4f07-b09d-39da26e77cad with Priority: HIGHEST for action security_group_rules [ 668.447378] env[70764]: INFO networking_nsxv3.common.synchronization [req-94839514-1292-45ed-880d-4857b4840096 req-a34e7d26-4c34-42ef-b0af-29a74976f86b service nova] Enqueued Resource ID: 83d2b431-6671-4f07-b09d-39da26e77cad with Priority: HIGHEST for action security_group_members [ 668.447519] env[70764]: INFO networking_nsxv3.common.synchronization [req-94839514-1292-45ed-880d-4857b4840096 req-a34e7d26-4c34-42ef-b0af-29a74976f86b service nova] Enqueued Resource ID: d57d3f51-44e0-4cf8-94f1-5ace0266534d with Priority: HIGHEST for action port [ 668.447744] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83d2b431-6671-4f07-b09d-39da26e77cad with Priority: HIGHEST for action security_group_rules [ 668.447955] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83d2b431-6671-4f07-b09d-39da26e77cad with Priority: HIGHEST for action security_group_members [ 668.447955] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d57d3f51-44e0-4cf8-94f1-5ace0266534d with Priority: HIGHEST for action port [ 668.448501] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83d2b431-6671-4f07-b09d-39da26e77cad taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.448629] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.448821] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.448922] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.449016] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83d2b431-6671-4f07-b09d-39da26e77cad',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.453760] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-83d2b431-6671-4f07-b09d-39da26e77cad taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.453760] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.453760] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.453926] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.454025] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.454428] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.456630] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.456630] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.456630] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.456630] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83d2b431-6671-4f07-b09d-39da26e77cad',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.456630] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-d57d3f51-44e0-4cf8-94f1-5ace0266534d taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.456630] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d57d3f51-44e0-4cf8-94f1-5ace0266534d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.456630] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d57d3f51-44e0-4cf8-94f1-5ace0266534d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.456630] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d57d3f51-44e0-4cf8-94f1-5ace0266534d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.456630] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d57d3f51-44e0-4cf8-94f1-5ace0266534d',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.462352] env[70764]: INFO networking_nsxv3.common.synchronization [req-2ea27a9a-d9e1-4030-a8fa-9dfdee8d4328 req-659f97be-aa65-4097-9872-38d8b4fd3c6a tempest-FloatingIPsAssociationNegativeTestJSON-1242754510 tempest-FloatingIPsAssociationNegativeTestJSON-1242754510-project-member] Enqueued Resource ID: 4c1c605b-e422-421f-b86e-88a41bb1f9f4 with Priority: HIGHEST for action security_group_members [ 668.463486] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c1c605b-e422-421f-b86e-88a41bb1f9f4 with Priority: HIGHEST for action security_group_members [ 668.464338] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c1c605b-e422-421f-b86e-88a41bb1f9f4 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.464338] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c1c605b-e422-421f-b86e-88a41bb1f9f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.464338] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c1c605b-e422-421f-b86e-88a41bb1f9f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.464338] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c1c605b-e422-421f-b86e-88a41bb1f9f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.464629] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.464629] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.464713] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.464890] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.464951] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.465658] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c1c605b-e422-421f-b86e-88a41bb1f9f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.546420] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9c2bf07-cd28-4135-994d-30a9140bcc35 in Status: SUCCESS [ 668.546687] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9c2bf07-cd28-4135-994d-30a9140bcc35" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.611183] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18c40e3b-51cd-431a-858a-22168889b4fd in Status: SUCCESS [ 668.611417] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18c40e3b-51cd-431a-858a-22168889b4fd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.611605] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18c40e3b-51cd-431a-858a-22168889b4fd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.611838] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18c40e3b-51cd-431a-858a-22168889b4fd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.612044] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.612173] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.612243] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.612434] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.612560] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.612668] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18c40e3b-51cd-431a-858a-22168889b4fd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.635077] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b in Status: SUCCESS [ 668.635311] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.635521] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.635687] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.635870] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.635984] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.636066] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.636362] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.636362] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.636473] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.669335] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-18c40e3b-51cd-431a-858a-22168889b4fd taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.669483] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18c40e3b-51cd-431a-858a-22168889b4fd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.678375] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdc56614-fc86-49b5-b218-5339e368633a in Status: SUCCESS [ 668.678499] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdc56614-fc86-49b5-b218-5339e368633a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.678653] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdc56614-fc86-49b5-b218-5339e368633a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.678870] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdc56614-fc86-49b5-b218-5339e368633a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.679083] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.679224] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.679312] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.679511] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.679627] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.679725] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdc56614-fc86-49b5-b218-5339e368633a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.679819] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fdc56614-fc86-49b5-b218-5339e368633a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.966019] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-83d2b431-6671-4f07-b09d-39da26e77cad taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.966019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.966019] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('83d2b431-6671-4f07-b09d-39da26e77cad',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.966019] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d57d3f51-44e0-4cf8-94f1-5ace0266534d with status ACTIVE [ 668.966019] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.966019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.968282] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.968282] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.968282] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.968497] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.968586] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.968658] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.968878] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.968990] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.969753] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.969893] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.969968] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.970188] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.970293] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.970417] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d57d3f51-44e0-4cf8-94f1-5ace0266534d is going to be updated. [ 668.971745] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.973034] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.973034] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.973034] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.973034] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.973034] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.973034] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.973034] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.973034] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.973034] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.973034] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c1c605b-e422-421f-b86e-88a41bb1f9f4 already deleted. [ 668.973591] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c1c605b-e422-421f-b86e-88a41bb1f9f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.002219] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.002219] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.002219] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.006311] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.006311] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.006311] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d57d3f51-44e0-4cf8-94f1-5ace0266534d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.042709] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82966c1e-4055-4b82-8cb6-2f08a28fcec0 in Status: SUCCESS [ 669.043022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82966c1e-4055-4b82-8cb6-2f08a28fcec0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.043256] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82966c1e-4055-4b82-8cb6-2f08a28fcec0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.043548] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82966c1e-4055-4b82-8cb6-2f08a28fcec0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.043807] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.043973] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.044088] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.044340] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.044418] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.044553] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82966c1e-4055-4b82-8cb6-2f08a28fcec0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.044876] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('82966c1e-4055-4b82-8cb6-2f08a28fcec0',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.117366] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('18c40e3b-51cd-431a-858a-22168889b4fd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.138613] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.182094] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fdc56614-fc86-49b5-b218-5339e368633a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.310305] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-826 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.310305] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-826" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.310305] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-826" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.310305] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-826" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.310305] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.310971] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.311368] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.311779] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.312111] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.312567] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 669.313094] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 669.313543] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 669.313543] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 669.313942] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 669.314488] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 669.314488] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 669.338887] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 669.339094] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 669.339574] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 669.339729] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-826" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.340175] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-5ce041a2-affd-4860-90d1-2fbb4f62abd7 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.341565] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-5ce041a2-affd-4860-90d1-2fbb4f62abd7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.341565] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-5ce041a2-affd-4860-90d1-2fbb4f62abd7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.341565] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-5ce041a2-affd-4860-90d1-2fbb4f62abd7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.341565] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ce041a2-affd-4860-90d1-2fbb4f62abd7',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.465910] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('83d2b431-6671-4f07-b09d-39da26e77cad',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.551189] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-82966c1e-4055-4b82-8cb6-2f08a28fcec0 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.551511] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82966c1e-4055-4b82-8cb6-2f08a28fcec0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.551625] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82966c1e-4055-4b82-8cb6-2f08a28fcec0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.551951] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82966c1e-4055-4b82-8cb6-2f08a28fcec0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.552241] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.552403] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.552504] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.552735] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.552881] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.553034] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82966c1e-4055-4b82-8cb6-2f08a28fcec0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.553265] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-82966c1e-4055-4b82-8cb6-2f08a28fcec0 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.553409] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82966c1e-4055-4b82-8cb6-2f08a28fcec0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.553503] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82966c1e-4055-4b82-8cb6-2f08a28fcec0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.553716] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82966c1e-4055-4b82-8cb6-2f08a28fcec0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.553922] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.554244] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.554358] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.554568] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.555099] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.555099] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82966c1e-4055-4b82-8cb6-2f08a28fcec0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.555099] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('82966c1e-4055-4b82-8cb6-2f08a28fcec0',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.621033] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('18c40e3b-51cd-431a-858a-22168889b4fd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.642318] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.686471] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fdc56614-fc86-49b5-b218-5339e368633a: rpc.has_security_group_logging(os_id): False [ 669.704794] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.704943] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.705032] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.705257] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.705342] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.705970] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.705970] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.705970] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.705970] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.705970] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.706705] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fdc56614-fc86-49b5-b218-5339e368633a is going to be created. [ 669.837237] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.837386] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.837455] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.837842] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.837842] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.846818] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.847256] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.847256] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.847677] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.847728] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.847874] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 5ce041a2-affd-4860-90d1-2fbb4f62abd7 not found, creating... [ 669.848508] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.848647] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.848771] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.849040] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.849190] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.849495] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.849674] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.849837] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.850159] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.850465] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.850614] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 5ce041a2-affd-4860-90d1-2fbb4f62abd7 is going to be created. [ 669.857024] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fdc56614-fc86-49b5-b218-5339e368633a in Status: IN_PROGRESS for 2s [ 669.868920] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.869391] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.869482] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.870881] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.870881] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.870881] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-5ce041a2-affd-4860-90d1-2fbb4f62abd7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.968950] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.971829] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.971829] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.971829] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.971829] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.971829] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83d2b431-6671-4f07-b09d-39da26e77cad is going to be created. [ 670.015412] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.015412] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.015412] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.015412] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.015412] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.024948] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83d2b431-6671-4f07-b09d-39da26e77cad in Status: UNINITIALIZED for 2s [ 670.059454] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 82966c1e-4055-4b82-8cb6-2f08a28fcec0: rpc.has_security_group_logging(os_id): False [ 670.077517] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.077667] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.078489] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.078489] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.078489] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.078489] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.078489] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.078758] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.078758] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.078894] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.078970] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.079060] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.079122] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.079275] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.079347] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.079525] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.079614] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.079676] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.079813] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.080082] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.080208] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 82966c1e-4055-4b82-8cb6-2f08a28fcec0 is going to be created. [ 670.123891] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.123891] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.123891] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.123891] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.123891] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.123891] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18c40e3b-51cd-431a-858a-22168889b4fd is going to be updated. [ 670.142082] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.142238] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.142305] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.142516] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.142695] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.145587] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.145587] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.145587] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.145587] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.145792] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.145792] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b is going to be updated. [ 670.163345] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 82966c1e-4055-4b82-8cb6-2f08a28fcec0 in Status: IN_PROGRESS for 2s [ 670.170540] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.170540] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.170540] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.170540] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.170540] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.189340] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18c40e3b-51cd-431a-858a-22168889b4fd in Status: IN_PROGRESS for 2s [ 670.200486] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.200486] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.200486] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.200486] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.200486] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.230950] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b in Status: IN_PROGRESS for 2s [ 670.893020] env[70764]: INFO networking_nsxv3.common.synchronization [req-2ea27a9a-d9e1-4030-a8fa-9dfdee8d4328 req-a71e09f7-f100-4f2d-b3c2-63768f6b14e2 service nova] Enqueued Resource ID: 4c1c605b-e422-421f-b86e-88a41bb1f9f4 with Priority: HIGHEST for action security_group_rules [ 670.893245] env[70764]: INFO networking_nsxv3.common.synchronization [req-2ea27a9a-d9e1-4030-a8fa-9dfdee8d4328 req-a71e09f7-f100-4f2d-b3c2-63768f6b14e2 service nova] Enqueued Resource ID: 4c1c605b-e422-421f-b86e-88a41bb1f9f4 with Priority: HIGHEST for action security_group_members [ 670.893415] env[70764]: INFO networking_nsxv3.common.synchronization [req-2ea27a9a-d9e1-4030-a8fa-9dfdee8d4328 req-a71e09f7-f100-4f2d-b3c2-63768f6b14e2 service nova] Enqueued Resource ID: 5ce041a2-affd-4860-90d1-2fbb4f62abd7 with Priority: HIGHEST for action port [ 670.893977] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c1c605b-e422-421f-b86e-88a41bb1f9f4 with Priority: HIGHEST for action security_group_rules [ 670.894203] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c1c605b-e422-421f-b86e-88a41bb1f9f4 with Priority: HIGHEST for action security_group_members [ 670.894279] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ce041a2-affd-4860-90d1-2fbb4f62abd7 with Priority: HIGHEST for action port [ 670.894514] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c1c605b-e422-421f-b86e-88a41bb1f9f4 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.894650] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c1c605b-e422-421f-b86e-88a41bb1f9f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.894716] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c1c605b-e422-421f-b86e-88a41bb1f9f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.894977] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c1c605b-e422-421f-b86e-88a41bb1f9f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.897750] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c1c605b-e422-421f-b86e-88a41bb1f9f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.898667] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c1c605b-e422-421f-b86e-88a41bb1f9f4 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.898911] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c1c605b-e422-421f-b86e-88a41bb1f9f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.898911] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c1c605b-e422-421f-b86e-88a41bb1f9f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.899053] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c1c605b-e422-421f-b86e-88a41bb1f9f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.899210] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.899311] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.899376] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.899635] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.899635] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.899723] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c1c605b-e422-421f-b86e-88a41bb1f9f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.900508] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ce041a2-affd-4860-90d1-2fbb4f62abd7 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.900630] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ce041a2-affd-4860-90d1-2fbb4f62abd7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.900697] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ce041a2-affd-4860-90d1-2fbb4f62abd7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.900966] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ce041a2-affd-4860-90d1-2fbb4f62abd7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.900966] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ce041a2-affd-4860-90d1-2fbb4f62abd7',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.409423] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c1c605b-e422-421f-b86e-88a41bb1f9f4 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.409750] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c1c605b-e422-421f-b86e-88a41bb1f9f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.409911] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4c1c605b-e422-421f-b86e-88a41bb1f9f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.412946] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5ce041a2-affd-4860-90d1-2fbb4f62abd7 with status ACTIVE [ 671.413193] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.413323] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.413393] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.413610] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.413676] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.413869] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.413973] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.414110] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.414294] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.414814] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.415204] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.415335] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.415407] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.415561] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.415638] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.415741] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5ce041a2-affd-4860-90d1-2fbb4f62abd7 is going to be updated. [ 671.436497] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.436497] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.436658] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.436772] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.436938] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.437135] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ce041a2-affd-4860-90d1-2fbb4f62abd7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.865913] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fdc56614-fc86-49b5-b218-5339e368633a in Status: SUCCESS [ 671.865913] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fdc56614-fc86-49b5-b218-5339e368633a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.911916] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4c1c605b-e422-421f-b86e-88a41bb1f9f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.034798] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83d2b431-6671-4f07-b09d-39da26e77cad in Status: SUCCESS [ 672.035034] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.035201] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.035429] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.035671] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.035809] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.035878] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.036054] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.036149] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.036241] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.036441] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('83d2b431-6671-4f07-b09d-39da26e77cad',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.174581] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 82966c1e-4055-4b82-8cb6-2f08a28fcec0 in Status: SUCCESS [ 672.174829] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-82966c1e-4055-4b82-8cb6-2f08a28fcec0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.198314] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18c40e3b-51cd-431a-858a-22168889b4fd in Status: SUCCESS [ 672.198634] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18c40e3b-51cd-431a-858a-22168889b4fd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.198896] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18c40e3b-51cd-431a-858a-22168889b4fd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.199206] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18c40e3b-51cd-431a-858a-22168889b4fd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.199486] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.199657] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.199734] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.199968] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.200221] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.200624] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18c40e3b-51cd-431a-858a-22168889b4fd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.200779] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('18c40e3b-51cd-431a-858a-22168889b4fd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.241225] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b in Status: SUCCESS [ 672.241473] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.241647] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.241872] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.242108] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.242238] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.242307] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.242493] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.242752] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.242752] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.242865] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.242932] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.243008] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.243159] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.243299] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.243392] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.243453] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.243590] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.243664] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.243745] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.243834] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.414469] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.414779] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.414779] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.414953] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.414953] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.415762] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c1c605b-e422-421f-b86e-88a41bb1f9f4 is going to be created. [ 672.439897] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.440206] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.440298] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.440710] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.440829] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.451764] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c1c605b-e422-421f-b86e-88a41bb1f9f4 in Status: UNINITIALIZED for 2s [ 672.546585] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('83d2b431-6671-4f07-b09d-39da26e77cad',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.703959] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('18c40e3b-51cd-431a-858a-22168889b4fd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.747545] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c2d79e00-b6b0-41f3-96fb-49ab2b10751b: rpc.has_security_group_logging(os_id): False [ 672.766574] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.766574] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.766574] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.766574] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.766574] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.766574] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.766574] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.766574] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.767111] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.767111] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.767111] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.767111] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.767349] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.767349] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.767454] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.767560] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.767661] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.767725] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.767833] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.767901] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.767982] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b is going to be updated. [ 672.824206] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.824446] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.824446] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.824644] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.824830] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.841248] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b in Status: IN_PROGRESS for 2s [ 673.052669] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 83d2b431-6671-4f07-b09d-39da26e77cad: rpc.has_security_group_logging(os_id): False [ 673.071394] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.071597] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.071663] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.071930] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.072100] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.072447] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.072592] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.072670] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.072901] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.072991] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.073103] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83d2b431-6671-4f07-b09d-39da26e77cad is going to be created. [ 673.133022] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.133022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.133022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.133022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.133022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.142480] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83d2b431-6671-4f07-b09d-39da26e77cad in Status: IN_PROGRESS for 2s [ 673.207029] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 18c40e3b-51cd-431a-858a-22168889b4fd: rpc.has_security_group_logging(os_id): False [ 673.228598] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.228855] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.228942] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.229236] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.229374] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.229635] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.229722] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.229839] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.230021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.230138] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.230183] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18c40e3b-51cd-431a-858a-22168889b4fd is going to be updated. [ 673.319415] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.319590] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.319670] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.319900] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.320105] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.333468] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18c40e3b-51cd-431a-858a-22168889b4fd in Status: IN_PROGRESS for 2s [ 674.068170] env[70764]: INFO networking_nsxv3.common.synchronization [None req-f51dd0e7-a831-47e8-b812-9bec0f5a68bc None None] Enqueued Resource ID: dc53efb3-75b2-4741-a995-5873447780cc with Priority: HIGHEST for action port [ 674.068170] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc53efb3-75b2-4741-a995-5873447780cc with Priority: HIGHEST for action port [ 674.069133] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc53efb3-75b2-4741-a995-5873447780cc taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.069133] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc53efb3-75b2-4741-a995-5873447780cc" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.069133] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc53efb3-75b2-4741-a995-5873447780cc" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.069334] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc53efb3-75b2-4741-a995-5873447780cc" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.069636] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc53efb3-75b2-4741-a995-5873447780cc',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.463561] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c1c605b-e422-421f-b86e-88a41bb1f9f4 in Status: SUCCESS [ 674.463867] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c1c605b-e422-421f-b86e-88a41bb1f9f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.464083] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c1c605b-e422-421f-b86e-88a41bb1f9f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.464333] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c1c605b-e422-421f-b86e-88a41bb1f9f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.464539] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.464925] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.465041] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.465269] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.465360] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.465462] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c1c605b-e422-421f-b86e-88a41bb1f9f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.465591] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4c1c605b-e422-421f-b86e-88a41bb1f9f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.575629] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dc53efb3-75b2-4741-a995-5873447780cc [ 674.575871] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.577449] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.577672] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.577907] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.578018] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.578133] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dc53efb3-75b2-4741-a995-5873447780cc already deleted. [ 674.578221] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc53efb3-75b2-4741-a995-5873447780cc" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.855958] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b in Status: SUCCESS [ 674.855958] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.856160] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.856380] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.856465] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.970319] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c1c605b-e422-421f-b86e-88a41bb1f9f4 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.970319] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c1c605b-e422-421f-b86e-88a41bb1f9f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.970319] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c1c605b-e422-421f-b86e-88a41bb1f9f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.970319] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c1c605b-e422-421f-b86e-88a41bb1f9f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.970319] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.970319] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.970319] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.970319] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.970319] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.970319] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c1c605b-e422-421f-b86e-88a41bb1f9f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.970319] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c1c605b-e422-421f-b86e-88a41bb1f9f4 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.970319] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c1c605b-e422-421f-b86e-88a41bb1f9f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.970319] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c1c605b-e422-421f-b86e-88a41bb1f9f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.970319] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c1c605b-e422-421f-b86e-88a41bb1f9f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.971226] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.971226] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.971226] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.971226] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.971226] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.971226] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c1c605b-e422-421f-b86e-88a41bb1f9f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.971542] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4c1c605b-e422-421f-b86e-88a41bb1f9f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.153665] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83d2b431-6671-4f07-b09d-39da26e77cad in Status: SUCCESS [ 675.154064] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.344631] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18c40e3b-51cd-431a-858a-22168889b4fd in Status: SUCCESS [ 675.344843] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18c40e3b-51cd-431a-858a-22168889b4fd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.358513] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.358677] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.358748] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.358976] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.359162] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.360725] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.360725] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.360725] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.360725] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.360725] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.360725] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.475218] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4c1c605b-e422-421f-b86e-88a41bb1f9f4: rpc.has_security_group_logging(os_id): False [ 675.491822] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.491822] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.491822] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.491822] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.492317] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.492710] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.492949] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.494019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.494019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.494019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.494019] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.494019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.494019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.494019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.494019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.494963] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.498341] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.498341] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.498341] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.498556] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.498648] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c1c605b-e422-421f-b86e-88a41bb1f9f4 is going to be created. [ 675.556662] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.557127] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.559020] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.559020] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.559020] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.568514] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c1c605b-e422-421f-b86e-88a41bb1f9f4 in Status: IN_PROGRESS for 2s [ 675.739353] env[70764]: INFO networking_nsxv3.common.synchronization [req-cb77fc2f-c262-4b09-90f2-f00f6481ec7c req-5d16b7fd-df7a-4f55-9dac-fc350a89afa9 tempest-ServerAddressesNegativeTestJSON-250220661 tempest-ServerAddressesNegativeTestJSON-250220661-project-member] Enqueued Resource ID: 2fc2deb2-a89e-4527-9c6b-7c33727bc09c with Priority: HIGHEST for action security_group_members [ 675.740127] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fc2deb2-a89e-4527-9c6b-7c33727bc09c with Priority: HIGHEST for action security_group_members [ 675.740418] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fc2deb2-a89e-4527-9c6b-7c33727bc09c taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.740566] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fc2deb2-a89e-4527-9c6b-7c33727bc09c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.740627] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fc2deb2-a89e-4527-9c6b-7c33727bc09c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.740911] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fc2deb2-a89e-4527-9c6b-7c33727bc09c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.741106] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.741269] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.741374] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.741597] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.741696] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.741804] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fc2deb2-a89e-4527-9c6b-7c33727bc09c',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.862233] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.862325] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.862361] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.862640] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.862813] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.862922] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.862982] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.863179] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.863261] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.863348] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.863519] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.863577] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.863635] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.863779] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.863930] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.864030] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.864104] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.864396] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.864396] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.864396] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.864523] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.247204] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.247204] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.247204] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.247204] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.247204] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.247204] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.247204] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.247204] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.247204] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.247204] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.247204] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fc2deb2-a89e-4527-9c6b-7c33727bc09c already deleted. [ 676.247204] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fc2deb2-a89e-4527-9c6b-7c33727bc09c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.273842] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-410 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.275300] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-410" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.275520] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-410" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.275852] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-410" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.276660] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.276660] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.276660] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.276889] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.276926] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.277271] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 676.277341] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 676.277464] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 676.277594] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 676.277726] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 676.277805] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 676.278020] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 676.282646] env[70764]: INFO networking_nsxv3.common.synchronization [req-0c9161de-e55c-4ce2-bf6f-03820e0e200a req-b0edaea4-a8fe-45af-8a17-3ed081ca839b tempest-ServerDiagnosticsNegativeTest-1553550798 tempest-ServerDiagnosticsNegativeTest-1553550798-project-member] Enqueued Resource ID: f9c2bf07-cd28-4135-994d-30a9140bcc35 with Priority: HIGHEST for action security_group_members [ 676.283591] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9c2bf07-cd28-4135-994d-30a9140bcc35 with Priority: HIGHEST for action security_group_members [ 676.284312] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9c2bf07-cd28-4135-994d-30a9140bcc35 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.284503] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9c2bf07-cd28-4135-994d-30a9140bcc35" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.284611] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9c2bf07-cd28-4135-994d-30a9140bcc35" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.284796] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9c2bf07-cd28-4135-994d-30a9140bcc35" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.285215] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.285215] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.285311] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.285896] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.285896] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.285896] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9c2bf07-cd28-4135-994d-30a9140bcc35',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.299080] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 676.299080] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 676.299080] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 676.299080] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-410" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.302155] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-6755591c-75f4-4e7b-81d3-d960d7351123 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.302155] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-6755591c-75f4-4e7b-81d3-d960d7351123" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.302155] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-6755591c-75f4-4e7b-81d3-d960d7351123" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.302155] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-6755591c-75f4-4e7b-81d3-d960d7351123" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.302155] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6755591c-75f4-4e7b-81d3-d960d7351123',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.366721] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c2d79e00-b6b0-41f3-96fb-49ab2b10751b: rpc.has_security_group_logging(os_id): False [ 676.384857] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.384857] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.384857] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.386644] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.386644] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.386644] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.386644] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.386644] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.386644] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.386644] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.387988] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.388569] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.390242] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.390242] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.390242] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.390242] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.390242] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.390242] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.390242] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.390242] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.390242] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b is going to be updated. [ 676.446963] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.449019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.449019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.449019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.449019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.461185] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b in Status: IN_PROGRESS for 2s [ 676.584604] env[70764]: INFO networking_nsxv3.common.synchronization [None req-03cbd1e8-80b2-4cc0-b715-6ee9d66e8043 None None] Enqueued Resource ID: ac607480-3c7d-4e60-a477-36fc8a5db7d7 with Priority: HIGHEST for action port [ 676.584604] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac607480-3c7d-4e60-a477-36fc8a5db7d7 with Priority: HIGHEST for action port [ 676.585418] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac607480-3c7d-4e60-a477-36fc8a5db7d7 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.585536] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac607480-3c7d-4e60-a477-36fc8a5db7d7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.585601] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac607480-3c7d-4e60-a477-36fc8a5db7d7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.585946] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac607480-3c7d-4e60-a477-36fc8a5db7d7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.585946] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac607480-3c7d-4e60-a477-36fc8a5db7d7',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.789650] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.789747] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.789801] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.790161] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.790280] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.792712] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.792712] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.792712] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.792712] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.792712] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.792712] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9c2bf07-cd28-4135-994d-30a9140bcc35 is going to be updated. [ 676.805377] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.805878] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.805878] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.807917] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.807917] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.807917] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 6755591c-75f4-4e7b-81d3-d960d7351123 not found, creating... [ 676.807917] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.807917] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.807917] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.807917] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.807917] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.807917] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.807917] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.808851] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.810032] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.810195] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.810353] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 6755591c-75f4-4e7b-81d3-d960d7351123 is going to be created. [ 676.826334] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.826334] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.826334] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.826334] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.826334] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.830143] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.830143] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.830328] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.830665] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.830826] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.831079] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-6755591c-75f4-4e7b-81d3-d960d7351123" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.834495] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9c2bf07-cd28-4135-994d-30a9140bcc35 in Status: IN_PROGRESS for 2s [ 677.092073] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ac607480-3c7d-4e60-a477-36fc8a5db7d7 [ 677.092073] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.092307] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.092307] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.092414] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.092512] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.092615] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ac607480-3c7d-4e60-a477-36fc8a5db7d7 already deleted. [ 677.092700] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac607480-3c7d-4e60-a477-36fc8a5db7d7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.579353] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c1c605b-e422-421f-b86e-88a41bb1f9f4 in Status: SUCCESS [ 677.579657] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c1c605b-e422-421f-b86e-88a41bb1f9f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.772476] env[70764]: INFO networking_nsxv3.common.synchronization [req-cb77fc2f-c262-4b09-90f2-f00f6481ec7c req-64523088-656b-457d-86cc-1dd66b2bc332 service nova] Enqueued Resource ID: 2fc2deb2-a89e-4527-9c6b-7c33727bc09c with Priority: HIGHEST for action security_group_rules [ 677.772476] env[70764]: INFO networking_nsxv3.common.synchronization [req-cb77fc2f-c262-4b09-90f2-f00f6481ec7c req-64523088-656b-457d-86cc-1dd66b2bc332 service nova] Enqueued Resource ID: 2fc2deb2-a89e-4527-9c6b-7c33727bc09c with Priority: HIGHEST for action security_group_members [ 677.772476] env[70764]: INFO networking_nsxv3.common.synchronization [req-cb77fc2f-c262-4b09-90f2-f00f6481ec7c req-64523088-656b-457d-86cc-1dd66b2bc332 service nova] Enqueued Resource ID: 6755591c-75f4-4e7b-81d3-d960d7351123 with Priority: HIGHEST for action port [ 677.773104] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fc2deb2-a89e-4527-9c6b-7c33727bc09c with Priority: HIGHEST for action security_group_rules [ 677.774462] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fc2deb2-a89e-4527-9c6b-7c33727bc09c with Priority: HIGHEST for action security_group_members [ 677.774462] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6755591c-75f4-4e7b-81d3-d960d7351123 with Priority: HIGHEST for action port [ 677.778313] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2fc2deb2-a89e-4527-9c6b-7c33727bc09c taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.778313] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2fc2deb2-a89e-4527-9c6b-7c33727bc09c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.778313] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2fc2deb2-a89e-4527-9c6b-7c33727bc09c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.778313] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2fc2deb2-a89e-4527-9c6b-7c33727bc09c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.778313] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2fc2deb2-a89e-4527-9c6b-7c33727bc09c',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.778313] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fc2deb2-a89e-4527-9c6b-7c33727bc09c taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.778313] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fc2deb2-a89e-4527-9c6b-7c33727bc09c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.778313] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fc2deb2-a89e-4527-9c6b-7c33727bc09c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.778313] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fc2deb2-a89e-4527-9c6b-7c33727bc09c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.778646] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.778646] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.778646] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.780099] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.780258] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.780374] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fc2deb2-a89e-4527-9c6b-7c33727bc09c',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.781357] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-6755591c-75f4-4e7b-81d3-d960d7351123 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.781491] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6755591c-75f4-4e7b-81d3-d960d7351123" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.781491] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6755591c-75f4-4e7b-81d3-d960d7351123" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.781804] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6755591c-75f4-4e7b-81d3-d960d7351123" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.781804] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6755591c-75f4-4e7b-81d3-d960d7351123',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.285669] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fc2deb2-a89e-4527-9c6b-7c33727bc09c taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.285798] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fc2deb2-a89e-4527-9c6b-7c33727bc09c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.286011] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2fc2deb2-a89e-4527-9c6b-7c33727bc09c',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.445255] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6755591c-75f4-4e7b-81d3-d960d7351123 with status ACTIVE [ 678.445255] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.445255] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.445255] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.445255] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.445255] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.445255] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.445255] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.445255] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.445255] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.445255] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.445255] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.445255] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.445255] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.445255] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.445255] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.445255] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6755591c-75f4-4e7b-81d3-d960d7351123 is going to be updated. [ 678.450859] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.450859] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.450859] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.450859] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.450859] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.450859] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6755591c-75f4-4e7b-81d3-d960d7351123" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.450859] env[70764]: INFO networking_nsxv3.common.synchronization [req-2f3a3249-4ac8-4b4f-a385-5e96fede077e req-9d62a649-170a-4f3e-91e3-22e41884c71c tempest-MigrationsAdminTest-1035321564 tempest-MigrationsAdminTest-1035321564-project-member] Enqueued Resource ID: 46f17c96-2a3a-415a-8b88-fe6fa64e3db5 with Priority: HIGHEST for action security_group_members [ 678.450859] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46f17c96-2a3a-415a-8b88-fe6fa64e3db5 with Priority: HIGHEST for action security_group_members [ 678.450859] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.450859] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.450859] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.450859] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.450859] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.450859] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.450859] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.450859] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.450859] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.450859] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46f17c96-2a3a-415a-8b88-fe6fa64e3db5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.476825] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b in Status: SUCCESS [ 678.476825] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.793155] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2fc2deb2-a89e-4527-9c6b-7c33727bc09c',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.843486] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9c2bf07-cd28-4135-994d-30a9140bcc35 in Status: SUCCESS [ 678.844321] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9c2bf07-cd28-4135-994d-30a9140bcc35 deletion is rescheduled due to dependency. [ 678.844474] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9c2bf07-cd28-4135-994d-30a9140bcc35" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.938857] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.939074] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.939167] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.939434] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.939578] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.939845] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.940043] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.940176] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.940438] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.940579] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.940713] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46f17c96-2a3a-415a-8b88-fe6fa64e3db5 already deleted. [ 678.940850] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.294255] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-343 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.294255] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-343" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.294255] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-343" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.294255] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-343" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.294255] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.294255] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.294255] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.294255] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.294255] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.294255] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 679.294255] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 679.294255] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 679.294255] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 679.295178] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 679.295178] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 679.295178] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 679.296337] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.300341] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.300341] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.300510] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.300559] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.300801] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fc2deb2-a89e-4527-9c6b-7c33727bc09c is going to be created. [ 679.322874] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 679.322874] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 679.323724] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 679.323817] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-343" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.324180] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-0fc62238-0cbf-4c72-9f12-d823e1974653 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.324778] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-0fc62238-0cbf-4c72-9f12-d823e1974653" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.324953] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-0fc62238-0cbf-4c72-9f12-d823e1974653" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.325313] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-0fc62238-0cbf-4c72-9f12-d823e1974653" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.325497] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0fc62238-0cbf-4c72-9f12-d823e1974653',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.327133] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.327813] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.327813] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.328536] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.328536] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.338531] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fc2deb2-a89e-4527-9c6b-7c33727bc09c in Status: UNINITIALIZED for 2s [ 679.833490] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.833908] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.833908] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.834153] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.834301] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.834448] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 0fc62238-0cbf-4c72-9f12-d823e1974653 not found, creating... [ 679.834727] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.834971] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.835074] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.836324] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.838720] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.839122] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.839478] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.839478] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.839649] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.839831] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.839996] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 0fc62238-0cbf-4c72-9f12-d823e1974653 is going to be created. [ 679.858803] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.859063] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.861525] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.861836] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.862136] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.862407] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-0fc62238-0cbf-4c72-9f12-d823e1974653" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.135151] env[70764]: INFO networking_nsxv3.common.synchronization [req-2f3a3249-4ac8-4b4f-a385-5e96fede077e req-388e6285-0d28-4a5e-b1fd-dec776b9c484 service nova] Enqueued Resource ID: 46f17c96-2a3a-415a-8b88-fe6fa64e3db5 with Priority: HIGHEST for action security_group_rules [ 681.135151] env[70764]: INFO networking_nsxv3.common.synchronization [req-2f3a3249-4ac8-4b4f-a385-5e96fede077e req-388e6285-0d28-4a5e-b1fd-dec776b9c484 service nova] Enqueued Resource ID: 46f17c96-2a3a-415a-8b88-fe6fa64e3db5 with Priority: HIGHEST for action security_group_members [ 681.135581] env[70764]: INFO networking_nsxv3.common.synchronization [req-2f3a3249-4ac8-4b4f-a385-5e96fede077e req-388e6285-0d28-4a5e-b1fd-dec776b9c484 service nova] Enqueued Resource ID: 0fc62238-0cbf-4c72-9f12-d823e1974653 with Priority: HIGHEST for action port [ 681.135581] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46f17c96-2a3a-415a-8b88-fe6fa64e3db5 with Priority: HIGHEST for action security_group_rules [ 681.135581] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46f17c96-2a3a-415a-8b88-fe6fa64e3db5 with Priority: HIGHEST for action security_group_members [ 681.135803] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fc62238-0cbf-4c72-9f12-d823e1974653 with Priority: HIGHEST for action port [ 681.136615] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46f17c96-2a3a-415a-8b88-fe6fa64e3db5 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.136615] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.136615] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.136615] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.136818] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46f17c96-2a3a-415a-8b88-fe6fa64e3db5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.137975] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.138268] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.138360] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.138532] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.138982] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.138982] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.138982] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.138982] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.139243] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.139243] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46f17c96-2a3a-415a-8b88-fe6fa64e3db5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.140783] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-0fc62238-0cbf-4c72-9f12-d823e1974653 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.140996] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0fc62238-0cbf-4c72-9f12-d823e1974653" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.140996] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0fc62238-0cbf-4c72-9f12-d823e1974653" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.141307] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0fc62238-0cbf-4c72-9f12-d823e1974653" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.141307] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0fc62238-0cbf-4c72-9f12-d823e1974653',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.172221] env[70764]: INFO networking_nsxv3.common.synchronization [req-652e7a05-a95b-4921-b457-180eeefca19c req-4cbf84aa-07c3-494f-b1bb-70d61b8a7d98 tempest-ServersAdminNegativeTestJSON-803035860 tempest-ServersAdminNegativeTestJSON-803035860-project-member] Enqueued Resource ID: a793445b-22a7-4c79-b31c-1beebe657659 with Priority: HIGHEST for action security_group_members [ 681.172738] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a793445b-22a7-4c79-b31c-1beebe657659 with Priority: HIGHEST for action security_group_members [ 681.173148] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-a793445b-22a7-4c79-b31c-1beebe657659 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.173329] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.173451] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.173736] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.173992] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.174172] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.174240] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.174434] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.174520] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.174648] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a793445b-22a7-4c79-b31c-1beebe657659',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.347323] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fc2deb2-a89e-4527-9c6b-7c33727bc09c in Status: SUCCESS [ 681.347566] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fc2deb2-a89e-4527-9c6b-7c33727bc09c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.347743] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fc2deb2-a89e-4527-9c6b-7c33727bc09c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.348000] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fc2deb2-a89e-4527-9c6b-7c33727bc09c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.348226] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.348355] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.348432] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.348595] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.348679] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.348766] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fc2deb2-a89e-4527-9c6b-7c33727bc09c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.348854] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2fc2deb2-a89e-4527-9c6b-7c33727bc09c',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.643143] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.643328] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.643543] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('46f17c96-2a3a-415a-8b88-fe6fa64e3db5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.645182] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0fc62238-0cbf-4c72-9f12-d823e1974653 with status ACTIVE [ 681.645421] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.645561] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.645663] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.645892] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.645991] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.646204] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.646318] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.646380] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.646545] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.646634] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.646837] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.647157] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.647250] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.647445] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.647496] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.647592] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0fc62238-0cbf-4c72-9f12-d823e1974653 is going to be updated. [ 681.678634] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.678861] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.681472] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.681472] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.681472] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.681472] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.681472] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.681472] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.681472] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.681472] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.681472] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a793445b-22a7-4c79-b31c-1beebe657659 already deleted. [ 681.681472] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.682232] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.682232] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.682232] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.682437] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.682505] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.683603] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0fc62238-0cbf-4c72-9f12-d823e1974653" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.850995] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fc2deb2-a89e-4527-9c6b-7c33727bc09c taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.851202] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fc2deb2-a89e-4527-9c6b-7c33727bc09c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.851320] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fc2deb2-a89e-4527-9c6b-7c33727bc09c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.851569] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fc2deb2-a89e-4527-9c6b-7c33727bc09c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.851829] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.851958] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.851996] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.852182] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.852272] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.852364] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fc2deb2-a89e-4527-9c6b-7c33727bc09c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.852519] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fc2deb2-a89e-4527-9c6b-7c33727bc09c taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.852624] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fc2deb2-a89e-4527-9c6b-7c33727bc09c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.852687] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fc2deb2-a89e-4527-9c6b-7c33727bc09c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.852822] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fc2deb2-a89e-4527-9c6b-7c33727bc09c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.852950] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.853082] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.853172] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.853281] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.853356] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.853443] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fc2deb2-a89e-4527-9c6b-7c33727bc09c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.854176] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2fc2deb2-a89e-4527-9c6b-7c33727bc09c',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.143591] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-343 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.143892] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-343" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.143987] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-343" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.144179] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-343" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.147905] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.147905] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.147905] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.147905] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.147905] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.147905] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 682.147905] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 682.147905] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 682.147905] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 682.147905] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 682.147905] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 682.147905] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 682.149769] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('46f17c96-2a3a-415a-8b88-fe6fa64e3db5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.166848] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 682.167014] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 682.167158] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 682.167332] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-343" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.167660] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-f9600b60-2590-480f-9146-748475c41a6d taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.167875] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-f9600b60-2590-480f-9146-748475c41a6d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.168009] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-f9600b60-2590-480f-9146-748475c41a6d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.168355] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-f9600b60-2590-480f-9146-748475c41a6d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.168488] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9600b60-2590-480f-9146-748475c41a6d',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.273703] env[70764]: INFO networking_nsxv3.common.synchronization [None req-1ef7fe68-01d0-4635-a7e2-e9ab9d8d8b0f None None] Enqueued Resource ID: b8f8e12d-ed61-4c12-bbfa-fa30b35c0fd9 with Priority: HIGHEST for action port [ 682.273989] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8f8e12d-ed61-4c12-bbfa-fa30b35c0fd9 with Priority: HIGHEST for action port [ 682.274557] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8f8e12d-ed61-4c12-bbfa-fa30b35c0fd9 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.274686] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8f8e12d-ed61-4c12-bbfa-fa30b35c0fd9" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.274756] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8f8e12d-ed61-4c12-bbfa-fa30b35c0fd9" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.275023] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8f8e12d-ed61-4c12-bbfa-fa30b35c0fd9" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.276160] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8f8e12d-ed61-4c12-bbfa-fa30b35c0fd9',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.330641] env[70764]: INFO networking_nsxv3.common.synchronization [None req-7dbedd55-7e6d-4066-923c-3537fb667414 None None] Enqueued Resource ID: 8c68bddb-8903-44e6-b2cd-c3053b879cbb with Priority: HIGHEST for action port [ 682.330760] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c68bddb-8903-44e6-b2cd-c3053b879cbb with Priority: HIGHEST for action port [ 682.332201] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c68bddb-8903-44e6-b2cd-c3053b879cbb taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.332201] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c68bddb-8903-44e6-b2cd-c3053b879cbb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.332201] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c68bddb-8903-44e6-b2cd-c3053b879cbb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.332474] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c68bddb-8903-44e6-b2cd-c3053b879cbb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.332603] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c68bddb-8903-44e6-b2cd-c3053b879cbb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.357961] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2fc2deb2-a89e-4527-9c6b-7c33727bc09c: rpc.has_security_group_logging(os_id): False [ 682.375626] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.375770] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.375847] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.376104] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.376165] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.377645] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.377645] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.377645] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.377645] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.377645] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.377645] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.377645] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.377645] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.377645] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.377645] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.377645] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.377645] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.377645] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.378489] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.378489] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.378489] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2fc2deb2-a89e-4527-9c6b-7c33727bc09c is going to be created. [ 682.433897] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.434159] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.434251] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.435133] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.435733] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.445550] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fc2deb2-a89e-4527-9c6b-7c33727bc09c in Status: IN_PROGRESS for 2s [ 682.658215] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.658215] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.658215] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.658215] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.658215] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.658215] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46f17c96-2a3a-415a-8b88-fe6fa64e3db5 is going to be created. [ 682.671038] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.671721] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.671721] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.671894] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.672058] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.672218] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port f9600b60-2590-480f-9146-748475c41a6d not found, creating... [ 682.672517] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.672679] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.673089] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.673337] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.673479] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.673768] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.673925] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.674107] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.674328] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.674469] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.674609] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: f9600b60-2590-480f-9146-748475c41a6d is going to be created. [ 682.682213] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.682338] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.682410] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.682581] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.682728] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.692345] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46f17c96-2a3a-415a-8b88-fe6fa64e3db5 in Status: UNINITIALIZED for 2s [ 682.696389] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.699013] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.699013] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.699013] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.699013] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.699013] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-f9600b60-2590-480f-9146-748475c41a6d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.778577] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b8f8e12d-ed61-4c12-bbfa-fa30b35c0fd9 [ 682.778822] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.778959] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.779079] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.779273] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.779365] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.779462] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b8f8e12d-ed61-4c12-bbfa-fa30b35c0fd9 already deleted. [ 682.779545] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8f8e12d-ed61-4c12-bbfa-fa30b35c0fd9" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.835776] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8c68bddb-8903-44e6-b2cd-c3053b879cbb [ 682.836014] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.836156] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.836236] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.836479] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.836528] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.836605] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8c68bddb-8903-44e6-b2cd-c3053b879cbb already deleted. [ 682.836711] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c68bddb-8903-44e6-b2cd-c3053b879cbb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.781052] env[70764]: INFO networking_nsxv3.common.synchronization [req-652e7a05-a95b-4921-b457-180eeefca19c req-25060e95-7554-4b1e-8047-5c76a0b64a7c service nova] Enqueued Resource ID: a793445b-22a7-4c79-b31c-1beebe657659 with Priority: HIGHEST for action security_group_rules [ 683.781395] env[70764]: INFO networking_nsxv3.common.synchronization [req-652e7a05-a95b-4921-b457-180eeefca19c req-25060e95-7554-4b1e-8047-5c76a0b64a7c service nova] Enqueued Resource ID: a793445b-22a7-4c79-b31c-1beebe657659 with Priority: HIGHEST for action security_group_members [ 683.781395] env[70764]: INFO networking_nsxv3.common.synchronization [req-652e7a05-a95b-4921-b457-180eeefca19c req-25060e95-7554-4b1e-8047-5c76a0b64a7c service nova] Enqueued Resource ID: f9600b60-2590-480f-9146-748475c41a6d with Priority: HIGHEST for action port [ 683.781711] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a793445b-22a7-4c79-b31c-1beebe657659 with Priority: HIGHEST for action security_group_rules [ 683.781792] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a793445b-22a7-4c79-b31c-1beebe657659 with Priority: HIGHEST for action security_group_members [ 683.781943] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9600b60-2590-480f-9146-748475c41a6d with Priority: HIGHEST for action port [ 683.782732] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a793445b-22a7-4c79-b31c-1beebe657659 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.782880] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.782950] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.783229] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.783349] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a793445b-22a7-4c79-b31c-1beebe657659',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.788572] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-a793445b-22a7-4c79-b31c-1beebe657659 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.788710] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.788789] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.790170] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.790170] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.790170] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.790170] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.790170] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.790170] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.790170] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a793445b-22a7-4c79-b31c-1beebe657659',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.795257] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-f9600b60-2590-480f-9146-748475c41a6d taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.795414] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f9600b60-2590-480f-9146-748475c41a6d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.795506] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f9600b60-2590-480f-9146-748475c41a6d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.796149] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f9600b60-2590-480f-9146-748475c41a6d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.796149] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9600b60-2590-480f-9146-748475c41a6d',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.298316] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-a793445b-22a7-4c79-b31c-1beebe657659 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.298436] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.298657] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a793445b-22a7-4c79-b31c-1beebe657659',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.300248] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f9600b60-2590-480f-9146-748475c41a6d with status ACTIVE [ 684.300531] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.300736] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.300826] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.301078] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.301195] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.301402] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.301518] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.301590] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.301780] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.301856] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.302087] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.302216] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.302295] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.302487] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.302583] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.302671] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f9600b60-2590-480f-9146-748475c41a6d is going to be updated. [ 684.324272] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.325010] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.325102] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.325394] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.325592] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.327511] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f9600b60-2590-480f-9146-748475c41a6d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.459599] env[70764]: INFO networking_nsxv3.common.synchronization [None req-e8a9b8c0-4c1f-4ece-a2c0-b14b13cec45e None None] Enqueued Resource ID: 79dfb00f-f0a7-46b7-b561-4ac8d466875a with Priority: HIGHEST for action port [ 684.461587] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79dfb00f-f0a7-46b7-b561-4ac8d466875a with Priority: HIGHEST for action port [ 684.462725] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fc2deb2-a89e-4527-9c6b-7c33727bc09c in Status: SUCCESS [ 684.463491] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2fc2deb2-a89e-4527-9c6b-7c33727bc09c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.464061] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-79dfb00f-f0a7-46b7-b561-4ac8d466875a taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.464344] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79dfb00f-f0a7-46b7-b561-4ac8d466875a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.465811] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79dfb00f-f0a7-46b7-b561-4ac8d466875a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.465811] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79dfb00f-f0a7-46b7-b561-4ac8d466875a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.465811] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79dfb00f-f0a7-46b7-b561-4ac8d466875a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.565700] env[70764]: INFO networking_nsxv3.common.synchronization [req-058bf2f4-18b3-4dee-bdec-b65a5849cdea req-33819b75-c4af-4c07-8f79-6026247cda2e tempest-ServerAddressesTestJSON-199602658 tempest-ServerAddressesTestJSON-199602658-project-member] Enqueued Resource ID: 82966c1e-4055-4b82-8cb6-2f08a28fcec0 with Priority: HIGHEST for action security_group_members [ 684.566247] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82966c1e-4055-4b82-8cb6-2f08a28fcec0 with Priority: HIGHEST for action security_group_members [ 684.566554] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-82966c1e-4055-4b82-8cb6-2f08a28fcec0 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.566681] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82966c1e-4055-4b82-8cb6-2f08a28fcec0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.566741] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82966c1e-4055-4b82-8cb6-2f08a28fcec0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.570022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82966c1e-4055-4b82-8cb6-2f08a28fcec0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.570022] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.570022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.570022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.570022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.570022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.570022] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82966c1e-4055-4b82-8cb6-2f08a28fcec0',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.639065] env[70764]: INFO networking_nsxv3.common.synchronization [None req-fc0c1d54-cc0e-4840-8d81-544f0e5b0122 None None] Enqueued Resource ID: c0f4cae6-98ea-43c2-bbe4-3d2f1c25d226 with Priority: HIGHEST for action port [ 684.639065] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0f4cae6-98ea-43c2-bbe4-3d2f1c25d226 with Priority: HIGHEST for action port [ 684.639622] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0f4cae6-98ea-43c2-bbe4-3d2f1c25d226 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.639806] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0f4cae6-98ea-43c2-bbe4-3d2f1c25d226" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.639936] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0f4cae6-98ea-43c2-bbe4-3d2f1c25d226" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.640262] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0f4cae6-98ea-43c2-bbe4-3d2f1c25d226" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.640403] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0f4cae6-98ea-43c2-bbe4-3d2f1c25d226',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.703282] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46f17c96-2a3a-415a-8b88-fe6fa64e3db5 in Status: SUCCESS [ 684.703450] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.703619] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.703839] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.704751] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.704943] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.705036] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.705223] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.705329] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.705425] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.705535] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('46f17c96-2a3a-415a-8b88-fe6fa64e3db5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.801476] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a793445b-22a7-4c79-b31c-1beebe657659',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.888111] env[70764]: INFO networking_nsxv3.common.synchronization [None req-a67a52bb-f247-4835-86a0-5b11a5129b40 tempest-AttachVolumeNegativeTest-232785497 tempest-AttachVolumeNegativeTest-232785497-project-member] Enqueued Resource ID: 837be310-7b7c-4ed0-9877-3473fe63d929 with Priority: HIGHEST for action security_group_rules [ 684.888690] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 837be310-7b7c-4ed0-9877-3473fe63d929 with Priority: HIGHEST for action security_group_rules [ 684.889447] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-837be310-7b7c-4ed0-9877-3473fe63d929 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.889447] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-837be310-7b7c-4ed0-9877-3473fe63d929" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.889713] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-837be310-7b7c-4ed0-9877-3473fe63d929" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.889825] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-837be310-7b7c-4ed0-9877-3473fe63d929" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.892020] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('837be310-7b7c-4ed0-9877-3473fe63d929',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.968136] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 79dfb00f-f0a7-46b7-b561-4ac8d466875a [ 684.968870] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.968870] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.968870] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.969113] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.970670] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.970670] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:79dfb00f-f0a7-46b7-b561-4ac8d466875a already deleted. [ 684.970670] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79dfb00f-f0a7-46b7-b561-4ac8d466875a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.012742] env[70764]: INFO networking_nsxv3.common.synchronization [None req-4c444614-5e62-455f-9e07-36bf6396590a tempest-AttachVolumeNegativeTest-232785497 tempest-AttachVolumeNegativeTest-232785497-project-member] Enqueued Resource ID: 837be310-7b7c-4ed0-9877-3473fe63d929 with Priority: HIGHEST for action security_group_rules [ 685.015039] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 837be310-7b7c-4ed0-9877-3473fe63d929 with Priority: HIGHEST for action security_group_rules [ 685.015039] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-837be310-7b7c-4ed0-9877-3473fe63d929 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.015039] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-837be310-7b7c-4ed0-9877-3473fe63d929" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.074091] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.074799] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.074799] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.074799] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.074799] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.075325] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.075325] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.075325] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.075325] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.077290] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.078449] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82966c1e-4055-4b82-8cb6-2f08a28fcec0 is going to be updated. [ 685.107368] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.107368] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.107368] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.107368] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.107368] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.116940] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82966c1e-4055-4b82-8cb6-2f08a28fcec0 in Status: IN_PROGRESS for 2s [ 685.143942] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c0f4cae6-98ea-43c2-bbe4-3d2f1c25d226 [ 685.145039] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.145039] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.145039] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.145039] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.145039] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.145039] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c0f4cae6-98ea-43c2-bbe4-3d2f1c25d226 already deleted. [ 685.145039] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0f4cae6-98ea-43c2-bbe4-3d2f1c25d226" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.211990] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.211990] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.211990] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.211990] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.211990] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.211990] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.211990] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.211990] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.211990] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.211990] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.211990] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.211990] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.211990] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.211990] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.212939] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.212939] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.212939] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.212939] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.212939] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.212939] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.212939] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('46f17c96-2a3a-415a-8b88-fe6fa64e3db5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.304463] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.304463] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.304463] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.305661] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.305765] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.305858] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a793445b-22a7-4c79-b31c-1beebe657659 is going to be created. [ 685.332019] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.332019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.332019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.332019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.332019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.339258] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a793445b-22a7-4c79-b31c-1beebe657659 in Status: UNINITIALIZED for 2s [ 685.410664] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.410664] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.410664] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.410664] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.411146] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.411146] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 837be310-7b7c-4ed0-9877-3473fe63d929 already deleted. [ 685.411146] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-837be310-7b7c-4ed0-9877-3473fe63d929" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.411146] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-837be310-7b7c-4ed0-9877-3473fe63d929" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.411613] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-837be310-7b7c-4ed0-9877-3473fe63d929" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.411613] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('837be310-7b7c-4ed0-9877-3473fe63d929',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.718247] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 46f17c96-2a3a-415a-8b88-fe6fa64e3db5: rpc.has_security_group_logging(os_id): False [ 685.736858] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.737080] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.737203] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.737372] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.737476] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.737703] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.737951] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.737951] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.738179] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.738179] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.738295] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.738557] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.738557] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.738671] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.738749] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.738957] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.740077] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.741494] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.741494] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.741572] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.741765] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46f17c96-2a3a-415a-8b88-fe6fa64e3db5 is going to be created. [ 685.792437] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.792637] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.792720] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.793151] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.793287] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.828365] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46f17c96-2a3a-415a-8b88-fe6fa64e3db5 in Status: IN_PROGRESS for 2s [ 685.935999] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.936234] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.936234] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.936452] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.936542] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.936657] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 837be310-7b7c-4ed0-9877-3473fe63d929 already deleted. [ 685.936745] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-837be310-7b7c-4ed0-9877-3473fe63d929" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.378544] env[70764]: INFO networking_nsxv3.common.synchronization [req-3af7e6f9-93fe-448b-9de7-0e7f338e28e3 req-1a9fe45d-276a-4ed5-b911-0da8dc520660 tempest-DeleteServersAdminTestJSON-513793110 tempest-DeleteServersAdminTestJSON-513793110-project-member] Enqueued Resource ID: 053f53ee-d0a4-4067-829d-5dc886808f18 with Priority: HIGHEST for action security_group_members [ 686.379558] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 053f53ee-d0a4-4067-829d-5dc886808f18 with Priority: HIGHEST for action security_group_members [ 686.379558] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-053f53ee-d0a4-4067-829d-5dc886808f18 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.379558] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.380342] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.380567] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.380744] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.380856] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.380972] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.381169] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.381348] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.381417] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('053f53ee-d0a4-4067-829d-5dc886808f18',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.885945] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.885945] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.885945] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.885945] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.885945] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.885945] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.885945] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.885945] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.885945] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.885945] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.885945] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 053f53ee-d0a4-4067-829d-5dc886808f18 is going to be updated. [ 686.899842] env[70764]: INFO networking_nsxv3.common.synchronization [req-a4282aa2-d5a1-4bdf-a308-377dd5aaf24b req-4ac00f25-8c2e-417f-8d28-06c05d403895 tempest-ImagesOneServerNegativeTestJSON-1318507346 tempest-ImagesOneServerNegativeTestJSON-1318507346-project-member] Enqueued Resource ID: 2a93825c-656b-4f3f-b946-3346edd746bf with Priority: HIGHEST for action security_group_members [ 686.899842] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a93825c-656b-4f3f-b946-3346edd746bf with Priority: HIGHEST for action security_group_members [ 686.901433] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a93825c-656b-4f3f-b946-3346edd746bf taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.904073] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.904073] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.904073] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.904073] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.904073] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.904073] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.904073] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.904073] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.904073] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a93825c-656b-4f3f-b946-3346edd746bf',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.911885] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.912350] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.912706] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.914800] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.914800] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.927952] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 053f53ee-d0a4-4067-829d-5dc886808f18 in Status: IN_PROGRESS for 2s [ 687.001479] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-343 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.001777] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-343" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.001944] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-343" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.002280] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-343" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.002600] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.002797] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.002930] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.003195] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.003342] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.003557] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 687.003688] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 687.003799] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 687.003908] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 687.004035] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 687.004129] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 687.004264] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 687.023499] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 687.023715] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 687.023863] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 687.024079] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-343" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.024416] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-65921805-d763-4791-8165-70c264f10146 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.024599] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-65921805-d763-4791-8165-70c264f10146" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.024722] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-65921805-d763-4791-8165-70c264f10146" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.025060] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-65921805-d763-4791-8165-70c264f10146" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.025204] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65921805-d763-4791-8165-70c264f10146',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.127275] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82966c1e-4055-4b82-8cb6-2f08a28fcec0 in Status: SUCCESS [ 687.127464] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82966c1e-4055-4b82-8cb6-2f08a28fcec0 deletion is rescheduled due to dependency. [ 687.127579] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82966c1e-4055-4b82-8cb6-2f08a28fcec0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.350417] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a793445b-22a7-4c79-b31c-1beebe657659 in Status: SUCCESS [ 687.350732] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.354299] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.354597] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.354862] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.354958] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.355053] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.355286] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.355347] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.355463] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.355602] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a793445b-22a7-4c79-b31c-1beebe657659',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.405278] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.405496] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.405496] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.405780] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.405879] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.406101] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.406207] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.406265] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.406416] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.406496] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.406581] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a93825c-656b-4f3f-b946-3346edd746bf is going to be updated. [ 687.432390] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.433136] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.433378] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.433785] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.434009] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.443535] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a93825c-656b-4f3f-b946-3346edd746bf in Status: IN_PROGRESS for 2s [ 687.528548] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.528548] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.528548] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.529306] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.529306] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.529306] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 65921805-d763-4791-8165-70c264f10146 not found, creating... [ 687.529534] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.529647] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.529786] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.529972] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.530424] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.530512] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.530642] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.530717] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.530922] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.531692] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.532108] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 65921805-d763-4791-8165-70c264f10146 is going to be created. [ 687.550777] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.551952] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.551952] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.551952] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.551952] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.551952] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-65921805-d763-4791-8165-70c264f10146" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.840060] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46f17c96-2a3a-415a-8b88-fe6fa64e3db5 in Status: SUCCESS [ 687.840334] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.858159] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-a793445b-22a7-4c79-b31c-1beebe657659 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.858379] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.858491] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.859054] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.859133] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.859268] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.859370] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.859606] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.859738] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.859882] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.860114] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-a793445b-22a7-4c79-b31c-1beebe657659 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.860252] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.860321] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.860477] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.860621] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.860713] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.860773] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.861506] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.861506] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.861506] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.861506] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a793445b-22a7-4c79-b31c-1beebe657659',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.364530] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a793445b-22a7-4c79-b31c-1beebe657659: rpc.has_security_group_logging(os_id): False [ 688.387688] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.387688] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.387688] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.387688] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.387688] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.388051] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.388051] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.388142] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.388279] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.388401] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.389033] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.389033] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.389033] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.389033] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.389033] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.390183] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.390324] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.390396] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.390603] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.391974] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.391974] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a793445b-22a7-4c79-b31c-1beebe657659 is going to be created. [ 688.451561] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.451832] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.451917] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.452278] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.452566] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.462664] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a793445b-22a7-4c79-b31c-1beebe657659 in Status: IN_PROGRESS for 2s [ 688.909703] env[70764]: INFO networking_nsxv3.common.synchronization [req-3af7e6f9-93fe-448b-9de7-0e7f338e28e3 req-d1800159-6d63-46bd-aeec-326eaca07fec service nova] Enqueued Resource ID: 053f53ee-d0a4-4067-829d-5dc886808f18 with Priority: HIGHEST for action security_group_rules [ 688.910839] env[70764]: INFO networking_nsxv3.common.synchronization [req-3af7e6f9-93fe-448b-9de7-0e7f338e28e3 req-d1800159-6d63-46bd-aeec-326eaca07fec service nova] Enqueued Resource ID: 053f53ee-d0a4-4067-829d-5dc886808f18 with Priority: HIGHEST for action security_group_members [ 688.911974] env[70764]: INFO networking_nsxv3.common.synchronization [req-3af7e6f9-93fe-448b-9de7-0e7f338e28e3 req-d1800159-6d63-46bd-aeec-326eaca07fec service nova] Enqueued Resource ID: 65921805-d763-4791-8165-70c264f10146 with Priority: HIGHEST for action port [ 688.911974] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 053f53ee-d0a4-4067-829d-5dc886808f18 with Priority: HIGHEST for action security_group_rules [ 688.911974] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 053f53ee-d0a4-4067-829d-5dc886808f18 with Priority: HIGHEST for action security_group_members [ 688.913086] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65921805-d763-4791-8165-70c264f10146 with Priority: HIGHEST for action port [ 688.916726] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-053f53ee-d0a4-4067-829d-5dc886808f18 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.916726] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.916726] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.916726] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.916726] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('053f53ee-d0a4-4067-829d-5dc886808f18',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.916726] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-053f53ee-d0a4-4067-829d-5dc886808f18 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.916726] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.916726] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-65921805-d763-4791-8165-70c264f10146 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.916726] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65921805-d763-4791-8165-70c264f10146" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.916726] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65921805-d763-4791-8165-70c264f10146" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.916726] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65921805-d763-4791-8165-70c264f10146" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.916726] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65921805-d763-4791-8165-70c264f10146',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.941985] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 053f53ee-d0a4-4067-829d-5dc886808f18 in Status: SUCCESS [ 688.943142] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 053f53ee-d0a4-4067-829d-5dc886808f18 deletion is rescheduled due to dependency. [ 688.946997] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.948531] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.948531] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.948531] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.948767] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.948767] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.949317] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.949317] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.949317] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('053f53ee-d0a4-4067-829d-5dc886808f18',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.420294] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-053f53ee-d0a4-4067-829d-5dc886808f18 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.420608] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.421132] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 65921805-d763-4791-8165-70c264f10146 with status ACTIVE [ 689.421132] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.421294] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.421294] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.421691] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.421782] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.422040] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.422191] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.422290] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.422517] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.423021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.423021] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.423021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.423192] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.423407] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.423468] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.423574] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 65921805-d763-4791-8165-70c264f10146 is going to be updated. [ 689.442955] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.443590] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.443590] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.443590] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.443785] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.444357] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65921805-d763-4791-8165-70c264f10146" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.455191] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a93825c-656b-4f3f-b946-3346edd746bf in Status: SUCCESS [ 689.455420] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a93825c-656b-4f3f-b946-3346edd746bf deletion is rescheduled due to dependency. [ 689.455569] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.455870] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('053f53ee-d0a4-4067-829d-5dc886808f18',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.961083] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('053f53ee-d0a4-4067-829d-5dc886808f18',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.467336] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.467336] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.467336] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.467336] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.467336] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.467336] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 053f53ee-d0a4-4067-829d-5dc886808f18 is going to be updated. [ 690.483707] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a793445b-22a7-4c79-b31c-1beebe657659 in Status: SUCCESS [ 690.483707] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.502659] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.502659] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.502659] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.502659] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.502659] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.513519] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 053f53ee-d0a4-4067-829d-5dc886808f18 in Status: IN_PROGRESS for 2s [ 691.915792] env[70764]: INFO networking_nsxv3.common.synchronization [req-3911eb24-532a-4a58-bfa2-b356ff95ad7e req-451bf276-d1f1-40ef-98a4-6788b876c912 tempest-ServerGroupTestJSON-1869869452 tempest-ServerGroupTestJSON-1869869452-project-member] Enqueued Resource ID: 48f2ee72-0aec-44b3-967c-055925852aa5 with Priority: HIGHEST for action security_group_members [ 691.916352] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48f2ee72-0aec-44b3-967c-055925852aa5 with Priority: HIGHEST for action security_group_members [ 691.916661] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-48f2ee72-0aec-44b3-967c-055925852aa5 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.916826] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48f2ee72-0aec-44b3-967c-055925852aa5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.916826] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48f2ee72-0aec-44b3-967c-055925852aa5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.917858] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48f2ee72-0aec-44b3-967c-055925852aa5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.918085] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.918248] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.918248] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.918550] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.918743] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.918743] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48f2ee72-0aec-44b3-967c-055925852aa5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.330199] env[70764]: INFO networking_nsxv3.common.synchronization [None req-59e871d8-09e1-42f1-ae07-88915c2acca8 None None] Enqueued Resource ID: 596d96cc-06d6-4bf8-a9bc-343a71448773 with Priority: HIGHEST for action port [ 692.330199] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 596d96cc-06d6-4bf8-a9bc-343a71448773 with Priority: HIGHEST for action port [ 692.330199] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-596d96cc-06d6-4bf8-a9bc-343a71448773 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.330199] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-596d96cc-06d6-4bf8-a9bc-343a71448773" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.330199] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-596d96cc-06d6-4bf8-a9bc-343a71448773" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.330199] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-596d96cc-06d6-4bf8-a9bc-343a71448773" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.330199] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('596d96cc-06d6-4bf8-a9bc-343a71448773',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.421713] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.421883] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.421949] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.422173] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.422264] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.422490] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.422621] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.422706] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.422864] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.422942] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.423037] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48f2ee72-0aec-44b3-967c-055925852aa5 already deleted. [ 692.423118] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48f2ee72-0aec-44b3-967c-055925852aa5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.527423] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 053f53ee-d0a4-4067-829d-5dc886808f18 in Status: SUCCESS [ 692.527659] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.527844] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.528072] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.528458] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.528544] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.528544] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.528722] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.528807] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.528894] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.529571] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('053f53ee-d0a4-4067-829d-5dc886808f18',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.765124] env[70764]: INFO networking_nsxv3.common.synchronization [req-e797eb3c-b93f-4f75-85c7-77fcf195cbaa req-277e6f30-00cf-4b9b-b621-df138a69e76d tempest-ServerAddressesNegativeTestJSON-250220661 tempest-ServerAddressesNegativeTestJSON-250220661-project-member] Enqueued Resource ID: 2fc2deb2-a89e-4527-9c6b-7c33727bc09c with Priority: HIGHEST for action security_group_members [ 692.765643] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fc2deb2-a89e-4527-9c6b-7c33727bc09c with Priority: HIGHEST for action security_group_members [ 692.765930] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fc2deb2-a89e-4527-9c6b-7c33727bc09c taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.766064] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fc2deb2-a89e-4527-9c6b-7c33727bc09c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.766129] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fc2deb2-a89e-4527-9c6b-7c33727bc09c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.766330] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fc2deb2-a89e-4527-9c6b-7c33727bc09c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.766467] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.766560] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.766619] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.766782] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.766866] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.766955] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fc2deb2-a89e-4527-9c6b-7c33727bc09c',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.834502] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 596d96cc-06d6-4bf8-a9bc-343a71448773 [ 692.834743] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.834875] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.834950] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.835166] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.835244] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.835344] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:596d96cc-06d6-4bf8-a9bc-343a71448773 already deleted. [ 692.835425] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-596d96cc-06d6-4bf8-a9bc-343a71448773" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.032801] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-053f53ee-d0a4-4067-829d-5dc886808f18 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.033099] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.033099] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.033263] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.033492] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.033603] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.033671] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.033826] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.033911] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.034008] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.034172] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-053f53ee-d0a4-4067-829d-5dc886808f18 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.034272] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.034320] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.034465] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.034602] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.034736] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.034736] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.034880] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.035014] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.035062] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.035143] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('053f53ee-d0a4-4067-829d-5dc886808f18',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.269956] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.270151] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.270898] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.270898] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.270898] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.270898] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.270898] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.271266] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.271266] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.271266] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.271266] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fc2deb2-a89e-4527-9c6b-7c33727bc09c is going to be updated. [ 693.302474] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.303666] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.303666] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.303666] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.303666] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.317429] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fc2deb2-a89e-4527-9c6b-7c33727bc09c in Status: IN_PROGRESS for 2s [ 693.432968] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-88 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.433256] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-88" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.433439] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-88" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.433917] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-88" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.439296] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.439296] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.439296] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.439296] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.439296] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.439296] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 693.439296] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 693.439296] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 693.439296] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 693.439296] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 693.439296] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 693.439296] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 693.458114] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 693.458354] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 693.458497] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 693.458675] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-88" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.459067] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-2e015c93-1f50-4c00-b480-4059577f2b03 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.459251] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-2e015c93-1f50-4c00-b480-4059577f2b03" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.459367] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-2e015c93-1f50-4c00-b480-4059577f2b03" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.459749] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-2e015c93-1f50-4c00-b480-4059577f2b03" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.459888] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e015c93-1f50-4c00-b480-4059577f2b03',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.513521] env[70764]: INFO networking_nsxv3.common.synchronization [None req-97f65fa2-73a6-4d22-9831-ee33ec1c1673 None None] Enqueued Resource ID: e49a3598-43a6-48a6-95fd-5024e66f5aef with Priority: HIGHEST for action port [ 693.514498] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e49a3598-43a6-48a6-95fd-5024e66f5aef with Priority: HIGHEST for action port [ 693.514903] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-e49a3598-43a6-48a6-95fd-5024e66f5aef taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.515335] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e49a3598-43a6-48a6-95fd-5024e66f5aef" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.515422] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e49a3598-43a6-48a6-95fd-5024e66f5aef" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.515720] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e49a3598-43a6-48a6-95fd-5024e66f5aef" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.515825] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e49a3598-43a6-48a6-95fd-5024e66f5aef',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.539829] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 053f53ee-d0a4-4067-829d-5dc886808f18: rpc.has_security_group_logging(os_id): False [ 693.557315] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.557503] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.557561] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.557761] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.557889] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.558078] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.558183] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.558235] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.558401] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.558503] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.559286] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.559286] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.559286] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.559286] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.559286] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.562656] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.563260] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.563260] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.563260] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.563260] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.563260] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 053f53ee-d0a4-4067-829d-5dc886808f18 is going to be updated. [ 693.638042] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.638246] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.638246] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.638924] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.638924] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.649836] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 053f53ee-d0a4-4067-829d-5dc886808f18 in Status: IN_PROGRESS for 2s [ 693.967824] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.968056] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.968760] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.968760] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.968954] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.969021] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 2e015c93-1f50-4c00-b480-4059577f2b03 not found, creating... [ 693.969320] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.969439] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.969521] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.969735] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.970025] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.970162] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.970393] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.970512] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.970719] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.970952] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.971055] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 2e015c93-1f50-4c00-b480-4059577f2b03 is going to be created. [ 693.996030] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.996030] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.996030] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.996487] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.996555] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.997474] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-2e015c93-1f50-4c00-b480-4059577f2b03" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.018505] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e49a3598-43a6-48a6-95fd-5024e66f5aef [ 694.018743] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.018885] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.018953] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.019202] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.019297] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.019414] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e49a3598-43a6-48a6-95fd-5024e66f5aef already deleted. [ 694.019474] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e49a3598-43a6-48a6-95fd-5024e66f5aef" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.143533] env[70764]: INFO networking_nsxv3.common.synchronization [req-cff76981-cd2e-439b-8fae-d40cce089ab5 req-07bdd3c5-8dfd-4c68-bbaa-50e69c4191fc tempest-ServersV294TestFqdnHostnames-288623823 tempest-ServersV294TestFqdnHostnames-288623823-project-member] Enqueued Resource ID: c0695687-32e8-4e4a-a8c8-31e6c3709596 with Priority: HIGHEST for action security_group_members [ 694.143533] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0695687-32e8-4e4a-a8c8-31e6c3709596 with Priority: HIGHEST for action security_group_members [ 694.143533] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0695687-32e8-4e4a-a8c8-31e6c3709596 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.143533] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0695687-32e8-4e4a-a8c8-31e6c3709596" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.143533] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0695687-32e8-4e4a-a8c8-31e6c3709596" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.143533] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0695687-32e8-4e4a-a8c8-31e6c3709596" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.144861] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.145146] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.145334] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.145589] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.145758] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.145928] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0695687-32e8-4e4a-a8c8-31e6c3709596',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.650385] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.650385] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.650385] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.650385] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.650385] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.650385] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.650385] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.650857] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.652365] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.652365] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.652365] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0695687-32e8-4e4a-a8c8-31e6c3709596 already deleted. [ 694.652365] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0695687-32e8-4e4a-a8c8-31e6c3709596" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.081140] env[70764]: INFO networking_nsxv3.common.synchronization [None req-a42e64ca-2bdd-4653-9ddd-1404515e30f7 None None] Enqueued Resource ID: dd0fe02f-194e-43a6-aa64-9a113b2d0d78 with Priority: HIGHEST for action port [ 695.081429] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd0fe02f-194e-43a6-aa64-9a113b2d0d78 with Priority: HIGHEST for action port [ 695.081984] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd0fe02f-194e-43a6-aa64-9a113b2d0d78 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.082134] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd0fe02f-194e-43a6-aa64-9a113b2d0d78" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.082200] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd0fe02f-194e-43a6-aa64-9a113b2d0d78" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.082606] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd0fe02f-194e-43a6-aa64-9a113b2d0d78" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.082606] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd0fe02f-194e-43a6-aa64-9a113b2d0d78',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.208803] env[70764]: INFO networking_nsxv3.common.synchronization [None req-99267ed0-856a-44f6-8946-318d7e1205a6 None None] Enqueued Resource ID: 5322e233-3a19-4746-a098-603a636d6858 with Priority: HIGHEST for action port [ 695.209380] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5322e233-3a19-4746-a098-603a636d6858 with Priority: HIGHEST for action port [ 695.210506] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-5322e233-3a19-4746-a098-603a636d6858 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.210940] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5322e233-3a19-4746-a098-603a636d6858" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.211140] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5322e233-3a19-4746-a098-603a636d6858" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.211414] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5322e233-3a19-4746-a098-603a636d6858" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.211558] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5322e233-3a19-4746-a098-603a636d6858',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.250756] env[70764]: INFO networking_nsxv3.common.synchronization [None req-d3869161-4b95-4b43-8173-22d60f381f64 tempest-AttachVolumeTestJSON-503324066 tempest-AttachVolumeTestJSON-503324066-project-member] Enqueued Resource ID: 6e903658-277d-417d-95d4-4fcc19078cba with Priority: HIGHEST for action security_group_rules [ 695.251522] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e903658-277d-417d-95d4-4fcc19078cba with Priority: HIGHEST for action security_group_rules [ 695.251840] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e903658-277d-417d-95d4-4fcc19078cba taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.252563] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e903658-277d-417d-95d4-4fcc19078cba" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.253091] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e903658-277d-417d-95d4-4fcc19078cba" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.253091] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e903658-277d-417d-95d4-4fcc19078cba" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.253199] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e903658-277d-417d-95d4-4fcc19078cba',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.328019] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fc2deb2-a89e-4527-9c6b-7c33727bc09c in Status: SUCCESS [ 695.328019] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fc2deb2-a89e-4527-9c6b-7c33727bc09c deletion is rescheduled due to dependency. [ 695.328019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fc2deb2-a89e-4527-9c6b-7c33727bc09c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.348055] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-126 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.348055] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-126" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.349176] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-126" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.349176] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-126" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.349176] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.349176] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.349747] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.350078] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.350404] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.350678] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 695.350849] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 695.351040] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 695.351346] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 695.351346] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 695.351591] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 695.351783] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 695.370145] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 695.370857] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 695.370857] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 695.370857] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-126" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.372330] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-1914c83d-47ae-4f92-b60b-8f7f012d9af2 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.373583] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-1914c83d-47ae-4f92-b60b-8f7f012d9af2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.373847] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-1914c83d-47ae-4f92-b60b-8f7f012d9af2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.374254] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-1914c83d-47ae-4f92-b60b-8f7f012d9af2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.374429] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1914c83d-47ae-4f92-b60b-8f7f012d9af2',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.473479] env[70764]: INFO networking_nsxv3.common.synchronization [None req-8f7044fa-51cb-4a30-ab63-92909f537d50 tempest-AttachVolumeTestJSON-503324066 tempest-AttachVolumeTestJSON-503324066-project-member] Enqueued Resource ID: 6e903658-277d-417d-95d4-4fcc19078cba with Priority: HIGHEST for action security_group_rules [ 695.475381] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e903658-277d-417d-95d4-4fcc19078cba with Priority: HIGHEST for action security_group_rules [ 695.475381] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e903658-277d-417d-95d4-4fcc19078cba taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.475381] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e903658-277d-417d-95d4-4fcc19078cba" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.505037] env[70764]: INFO networking_nsxv3.common.synchronization [req-3911eb24-532a-4a58-bfa2-b356ff95ad7e req-57271c9f-60fa-4ec2-91d1-896b2babdd1f service nova] Enqueued Resource ID: 48f2ee72-0aec-44b3-967c-055925852aa5 with Priority: HIGHEST for action security_group_rules [ 695.505037] env[70764]: INFO networking_nsxv3.common.synchronization [req-3911eb24-532a-4a58-bfa2-b356ff95ad7e req-57271c9f-60fa-4ec2-91d1-896b2babdd1f service nova] Enqueued Resource ID: 48f2ee72-0aec-44b3-967c-055925852aa5 with Priority: HIGHEST for action security_group_members [ 695.505357] env[70764]: INFO networking_nsxv3.common.synchronization [req-3911eb24-532a-4a58-bfa2-b356ff95ad7e req-57271c9f-60fa-4ec2-91d1-896b2babdd1f service nova] Enqueued Resource ID: 2e015c93-1f50-4c00-b480-4059577f2b03 with Priority: HIGHEST for action port [ 695.506999] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48f2ee72-0aec-44b3-967c-055925852aa5 with Priority: HIGHEST for action security_group_rules [ 695.506999] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48f2ee72-0aec-44b3-967c-055925852aa5 with Priority: HIGHEST for action security_group_members [ 695.506999] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e015c93-1f50-4c00-b480-4059577f2b03 with Priority: HIGHEST for action port [ 695.506999] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48f2ee72-0aec-44b3-967c-055925852aa5 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.506999] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48f2ee72-0aec-44b3-967c-055925852aa5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.506999] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48f2ee72-0aec-44b3-967c-055925852aa5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.506999] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48f2ee72-0aec-44b3-967c-055925852aa5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.506999] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48f2ee72-0aec-44b3-967c-055925852aa5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.508229] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-48f2ee72-0aec-44b3-967c-055925852aa5 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.508229] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48f2ee72-0aec-44b3-967c-055925852aa5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.508330] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48f2ee72-0aec-44b3-967c-055925852aa5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.508440] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48f2ee72-0aec-44b3-967c-055925852aa5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.508582] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.508683] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.508746] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.510925] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.510925] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.510925] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48f2ee72-0aec-44b3-967c-055925852aa5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.510925] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e015c93-1f50-4c00-b480-4059577f2b03 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.510925] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e015c93-1f50-4c00-b480-4059577f2b03" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.510925] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e015c93-1f50-4c00-b480-4059577f2b03" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.510925] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e015c93-1f50-4c00-b480-4059577f2b03" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.510925] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e015c93-1f50-4c00-b480-4059577f2b03',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.587510] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dd0fe02f-194e-43a6-aa64-9a113b2d0d78 [ 695.587794] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.587923] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.587994] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.588616] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.588721] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.588805] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dd0fe02f-194e-43a6-aa64-9a113b2d0d78 already deleted. [ 695.588886] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd0fe02f-194e-43a6-aa64-9a113b2d0d78" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.669868] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 053f53ee-d0a4-4067-829d-5dc886808f18 in Status: SUCCESS [ 695.670215] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.714182] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5322e233-3a19-4746-a098-603a636d6858 [ 695.714756] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.714756] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.714756] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.714942] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.714942] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.715281] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5322e233-3a19-4746-a098-603a636d6858 already deleted. [ 695.715412] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5322e233-3a19-4746-a098-603a636d6858" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.771964] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.772610] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.773701] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.773701] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.773701] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.773701] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e903658-277d-417d-95d4-4fcc19078cba already deleted. [ 695.773701] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e903658-277d-417d-95d4-4fcc19078cba" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.773701] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e903658-277d-417d-95d4-4fcc19078cba" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.774040] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e903658-277d-417d-95d4-4fcc19078cba" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.774126] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e903658-277d-417d-95d4-4fcc19078cba',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.878722] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.878722] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.878722] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.879012] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.879168] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.879328] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 1914c83d-47ae-4f92-b60b-8f7f012d9af2 not found, creating... [ 695.879584] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.879743] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.879859] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.884849] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.884849] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.884849] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.884849] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.884849] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.884849] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.884849] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.885240] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 1914c83d-47ae-4f92-b60b-8f7f012d9af2 is going to be created. [ 695.907172] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.908921] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.909140] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.909508] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.909747] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.910016] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-1914c83d-47ae-4f92-b60b-8f7f012d9af2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.013087] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-48f2ee72-0aec-44b3-967c-055925852aa5 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.013334] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48f2ee72-0aec-44b3-967c-055925852aa5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.013603] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48f2ee72-0aec-44b3-967c-055925852aa5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.015060] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2e015c93-1f50-4c00-b480-4059577f2b03 with status ACTIVE [ 696.015343] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.015449] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.015449] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.015642] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.015730] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.015897] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.015997] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.016551] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.018595] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.018595] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.018595] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.018595] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.018595] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.018595] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.018595] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.018595] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2e015c93-1f50-4c00-b480-4059577f2b03 is going to be updated. [ 696.047350] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.047503] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.047574] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.047788] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.047924] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.048112] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e015c93-1f50-4c00-b480-4059577f2b03" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.297964] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.298257] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.298257] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.298720] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.298720] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.298830] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e903658-277d-417d-95d4-4fcc19078cba already deleted. [ 696.298960] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e903658-277d-417d-95d4-4fcc19078cba" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.520573] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48f2ee72-0aec-44b3-967c-055925852aa5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.924348] env[70764]: INFO networking_nsxv3.common.synchronization [req-cff76981-cd2e-439b-8fae-d40cce089ab5 req-7d31ca45-d5df-4196-8cf9-f175c0f51fd9 service nova] Enqueued Resource ID: c0695687-32e8-4e4a-a8c8-31e6c3709596 with Priority: HIGHEST for action security_group_rules [ 696.924348] env[70764]: INFO networking_nsxv3.common.synchronization [req-cff76981-cd2e-439b-8fae-d40cce089ab5 req-7d31ca45-d5df-4196-8cf9-f175c0f51fd9 service nova] Enqueued Resource ID: c0695687-32e8-4e4a-a8c8-31e6c3709596 with Priority: HIGHEST for action security_group_members [ 696.924348] env[70764]: INFO networking_nsxv3.common.synchronization [req-cff76981-cd2e-439b-8fae-d40cce089ab5 req-7d31ca45-d5df-4196-8cf9-f175c0f51fd9 service nova] Enqueued Resource ID: 1914c83d-47ae-4f92-b60b-8f7f012d9af2 with Priority: HIGHEST for action port [ 696.924472] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0695687-32e8-4e4a-a8c8-31e6c3709596 with Priority: HIGHEST for action security_group_rules [ 696.924714] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0695687-32e8-4e4a-a8c8-31e6c3709596 with Priority: HIGHEST for action security_group_members [ 696.924714] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1914c83d-47ae-4f92-b60b-8f7f012d9af2 with Priority: HIGHEST for action port [ 696.925188] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0695687-32e8-4e4a-a8c8-31e6c3709596 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.925645] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0695687-32e8-4e4a-a8c8-31e6c3709596" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.925645] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0695687-32e8-4e4a-a8c8-31e6c3709596" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.925645] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0695687-32e8-4e4a-a8c8-31e6c3709596" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.925645] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0695687-32e8-4e4a-a8c8-31e6c3709596',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.926995] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0695687-32e8-4e4a-a8c8-31e6c3709596 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.928055] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0695687-32e8-4e4a-a8c8-31e6c3709596" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.928055] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0695687-32e8-4e4a-a8c8-31e6c3709596" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.928055] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0695687-32e8-4e4a-a8c8-31e6c3709596" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.928055] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.928336] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.928336] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.928684] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.928790] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.930906] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0695687-32e8-4e4a-a8c8-31e6c3709596',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.930906] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-1914c83d-47ae-4f92-b60b-8f7f012d9af2 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.930906] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1914c83d-47ae-4f92-b60b-8f7f012d9af2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.930906] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1914c83d-47ae-4f92-b60b-8f7f012d9af2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.930906] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1914c83d-47ae-4f92-b60b-8f7f012d9af2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.930906] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1914c83d-47ae-4f92-b60b-8f7f012d9af2',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.025265] env[70764]: INFO networking_nsxv3.common.synchronization [None req-84983d89-5093-43a1-9429-bc636535310e None None] Enqueued Resource ID: aa118f8a-f6bf-48e4-92e3-ad72ab75cd54 with Priority: HIGHEST for action port [ 697.027575] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.027763] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.027763] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.028013] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.028051] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.028153] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48f2ee72-0aec-44b3-967c-055925852aa5 is going to be created. [ 697.029251] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa118f8a-f6bf-48e4-92e3-ad72ab75cd54 with Priority: HIGHEST for action port [ 697.030282] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa118f8a-f6bf-48e4-92e3-ad72ab75cd54 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.030422] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa118f8a-f6bf-48e4-92e3-ad72ab75cd54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.030523] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa118f8a-f6bf-48e4-92e3-ad72ab75cd54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.030767] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa118f8a-f6bf-48e4-92e3-ad72ab75cd54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.030854] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa118f8a-f6bf-48e4-92e3-ad72ab75cd54',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.052641] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.052641] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.052641] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.052872] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.052872] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.062938] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48f2ee72-0aec-44b3-967c-055925852aa5 in Status: UNINITIALIZED for 2s [ 697.174291] env[70764]: INFO networking_nsxv3.common.synchronization [None req-d414f7e3-64c6-4da2-a2ea-fd486a96dfe5 None None] Enqueued Resource ID: e6cf4030-d7dc-4c4e-9f91-76054d10f6a0 with Priority: HIGHEST for action port [ 697.174944] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6cf4030-d7dc-4c4e-9f91-76054d10f6a0 with Priority: HIGHEST for action port [ 697.176011] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-e6cf4030-d7dc-4c4e-9f91-76054d10f6a0 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.176011] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e6cf4030-d7dc-4c4e-9f91-76054d10f6a0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.176011] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e6cf4030-d7dc-4c4e-9f91-76054d10f6a0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.176255] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e6cf4030-d7dc-4c4e-9f91-76054d10f6a0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.176291] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6cf4030-d7dc-4c4e-9f91-76054d10f6a0',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.432974] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0695687-32e8-4e4a-a8c8-31e6c3709596 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.433292] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0695687-32e8-4e4a-a8c8-31e6c3709596" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.433359] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0695687-32e8-4e4a-a8c8-31e6c3709596',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.434273] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1914c83d-47ae-4f92-b60b-8f7f012d9af2 with status ACTIVE [ 697.434461] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.436016] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.436016] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.436016] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.436016] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.436016] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.436016] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.436016] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.436016] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.436016] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.436016] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.436016] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.436016] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.439236] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.439362] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.439458] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1914c83d-47ae-4f92-b60b-8f7f012d9af2 is going to be updated. [ 697.461225] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.461318] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.461379] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.461729] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.461729] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.461944] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1914c83d-47ae-4f92-b60b-8f7f012d9af2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.534561] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aa118f8a-f6bf-48e4-92e3-ad72ab75cd54 [ 697.534561] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.534561] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.534561] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.534889] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.534889] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.534889] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aa118f8a-f6bf-48e4-92e3-ad72ab75cd54 already deleted. [ 697.534988] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa118f8a-f6bf-48e4-92e3-ad72ab75cd54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.569132] env[70764]: INFO networking_nsxv3.common.synchronization [None req-06d891d2-2a3b-4422-b754-7f04db6c062a tempest-ServerActionsTestJSON-288318646 tempest-ServerActionsTestJSON-288318646-project-member] Enqueued Resource ID: 527aa039-9b45-4682-bffb-ac71e24551a1 with Priority: HIGHEST for action security_group_rules [ 697.569132] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 527aa039-9b45-4682-bffb-ac71e24551a1 with Priority: HIGHEST for action security_group_rules [ 697.569132] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-527aa039-9b45-4682-bffb-ac71e24551a1 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.569623] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.569623] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.569707] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.569791] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('527aa039-9b45-4682-bffb-ac71e24551a1',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.662666] env[70764]: INFO networking_nsxv3.common.synchronization [None req-9fbe22e4-8e61-4c0e-903a-9102d3528724 tempest-ServerActionsTestJSON-288318646 tempest-ServerActionsTestJSON-288318646-project-member] Enqueued Resource ID: 527aa039-9b45-4682-bffb-ac71e24551a1 with Priority: HIGHEST for action security_group_rules [ 697.662777] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 527aa039-9b45-4682-bffb-ac71e24551a1 with Priority: HIGHEST for action security_group_rules [ 697.663040] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-527aa039-9b45-4682-bffb-ac71e24551a1 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.663149] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.682717] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e6cf4030-d7dc-4c4e-9f91-76054d10f6a0 [ 697.682968] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.684114] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.684114] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.684114] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.684114] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.684114] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e6cf4030-d7dc-4c4e-9f91-76054d10f6a0 already deleted. [ 697.684114] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e6cf4030-d7dc-4c4e-9f91-76054d10f6a0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.942637] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0695687-32e8-4e4a-a8c8-31e6c3709596',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.094934] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.095190] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.095190] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.095554] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.095654] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.095757] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 527aa039-9b45-4682-bffb-ac71e24551a1 already deleted. [ 698.095843] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.096234] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.096671] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.096671] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('527aa039-9b45-4682-bffb-ac71e24551a1',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.445844] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.446182] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.446182] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.446302] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.446391] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.446492] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0695687-32e8-4e4a-a8c8-31e6c3709596 is going to be created. [ 698.469118] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.469296] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.469360] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.469576] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.469750] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.478496] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0695687-32e8-4e4a-a8c8-31e6c3709596 in Status: UNINITIALIZED for 2s [ 698.620559] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.620845] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.620845] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.621028] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.621121] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.621217] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 527aa039-9b45-4682-bffb-ac71e24551a1 already deleted. [ 698.621318] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.073984] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48f2ee72-0aec-44b3-967c-055925852aa5 in Status: SUCCESS [ 699.074149] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48f2ee72-0aec-44b3-967c-055925852aa5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.074330] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48f2ee72-0aec-44b3-967c-055925852aa5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.074541] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48f2ee72-0aec-44b3-967c-055925852aa5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.074733] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.074856] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.074920] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.075083] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.075166] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.075251] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48f2ee72-0aec-44b3-967c-055925852aa5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.075426] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('48f2ee72-0aec-44b3-967c-055925852aa5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.578713] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-48f2ee72-0aec-44b3-967c-055925852aa5 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.578713] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48f2ee72-0aec-44b3-967c-055925852aa5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.578713] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48f2ee72-0aec-44b3-967c-055925852aa5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.578713] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48f2ee72-0aec-44b3-967c-055925852aa5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.579232] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.579232] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.579232] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.579232] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.579232] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.579432] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48f2ee72-0aec-44b3-967c-055925852aa5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.579432] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-48f2ee72-0aec-44b3-967c-055925852aa5 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.579505] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48f2ee72-0aec-44b3-967c-055925852aa5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.579541] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48f2ee72-0aec-44b3-967c-055925852aa5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.579683] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48f2ee72-0aec-44b3-967c-055925852aa5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.579802] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.579896] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.579957] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.580118] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.580196] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.580277] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48f2ee72-0aec-44b3-967c-055925852aa5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.580421] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('48f2ee72-0aec-44b3-967c-055925852aa5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.083091] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 48f2ee72-0aec-44b3-967c-055925852aa5: rpc.has_security_group_logging(os_id): False [ 700.106453] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.106687] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.106758] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.106975] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.107077] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.107478] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.107688] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.107688] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.107859] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.107898] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.108322] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.108322] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.108322] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.108522] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.108522] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.112026] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.112026] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.112026] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.112026] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.112026] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.112026] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48f2ee72-0aec-44b3-967c-055925852aa5 is going to be created. [ 700.174444] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.174589] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.174652] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.174871] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.175112] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.195035] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48f2ee72-0aec-44b3-967c-055925852aa5 in Status: IN_PROGRESS for 2s [ 700.492029] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0695687-32e8-4e4a-a8c8-31e6c3709596 in Status: SUCCESS [ 700.492029] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0695687-32e8-4e4a-a8c8-31e6c3709596" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.492029] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0695687-32e8-4e4a-a8c8-31e6c3709596" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.492029] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0695687-32e8-4e4a-a8c8-31e6c3709596" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.492029] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.492029] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.492029] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.492029] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.492029] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.492029] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0695687-32e8-4e4a-a8c8-31e6c3709596" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.492029] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0695687-32e8-4e4a-a8c8-31e6c3709596',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.994997] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0695687-32e8-4e4a-a8c8-31e6c3709596',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.497574] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0695687-32e8-4e4a-a8c8-31e6c3709596: rpc.has_security_group_logging(os_id): False [ 701.517869] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.517984] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.517984] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.518328] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.518443] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.518731] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.518843] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.518909] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.519449] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.519449] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.519449] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0695687-32e8-4e4a-a8c8-31e6c3709596 is going to be created. [ 701.579170] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.579170] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.579170] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.579331] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.579508] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.590340] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0695687-32e8-4e4a-a8c8-31e6c3709596 in Status: IN_PROGRESS for 2s [ 701.992576] env[70764]: INFO networking_nsxv3.common.synchronization [req-ed2d14b5-1193-4415-8089-8e23197a293d req-22e95cea-2374-4ffc-acb1-b51ca9afe277 tempest-FloatingIPsAssociationNegativeTestJSON-1242754510 tempest-FloatingIPsAssociationNegativeTestJSON-1242754510-project-member] Enqueued Resource ID: 4c1c605b-e422-421f-b86e-88a41bb1f9f4 with Priority: HIGHEST for action security_group_members [ 701.993401] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c1c605b-e422-421f-b86e-88a41bb1f9f4 with Priority: HIGHEST for action security_group_members [ 701.993777] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c1c605b-e422-421f-b86e-88a41bb1f9f4 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.993950] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c1c605b-e422-421f-b86e-88a41bb1f9f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.994203] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c1c605b-e422-421f-b86e-88a41bb1f9f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.994458] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c1c605b-e422-421f-b86e-88a41bb1f9f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.994630] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.994756] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.994847] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.995020] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.995293] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.995293] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c1c605b-e422-421f-b86e-88a41bb1f9f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.194728] env[70764]: INFO networking_nsxv3.common.synchronization [req-78778e89-c24f-4fb1-939e-0c9ee2030abf req-7e7033ae-927e-4128-8750-595d94dc96f0 tempest-ServersAdminTestJSON-868847224 tempest-ServersAdminTestJSON-868847224-project-member] Enqueued Resource ID: 5e9c0048-237b-4cab-86e0-e56dce546daa with Priority: HIGHEST for action security_group_members [ 702.195318] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e9c0048-237b-4cab-86e0-e56dce546daa with Priority: HIGHEST for action security_group_members [ 702.196186] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e9c0048-237b-4cab-86e0-e56dce546daa taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.196253] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.196339] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.196625] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.196822] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.197059] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.197059] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.197194] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.197249] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.201055] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e9c0048-237b-4cab-86e0-e56dce546daa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.210389] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48f2ee72-0aec-44b3-967c-055925852aa5 in Status: SUCCESS [ 702.210389] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48f2ee72-0aec-44b3-967c-055925852aa5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.289807] env[70764]: INFO networking_nsxv3.common.synchronization [req-ca4d11af-4a2d-4514-9a9d-1d8900a701ef req-1f3807d6-eec2-49fe-a0b5-403c59eda28e tempest-DeleteServersAdminTestJSON-513793110 tempest-DeleteServersAdminTestJSON-513793110-project-member] Enqueued Resource ID: 053f53ee-d0a4-4067-829d-5dc886808f18 with Priority: HIGHEST for action security_group_members [ 702.289807] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 053f53ee-d0a4-4067-829d-5dc886808f18 with Priority: HIGHEST for action security_group_members [ 702.290080] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-053f53ee-d0a4-4067-829d-5dc886808f18 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.290645] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.290645] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.290645] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.290802] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.290877] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.290927] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.291107] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.291207] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.291265] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('053f53ee-d0a4-4067-829d-5dc886808f18',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.497070] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.497252] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.497362] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.497533] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.497621] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.497825] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.497931] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.497971] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.498149] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.498240] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.498333] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c1c605b-e422-421f-b86e-88a41bb1f9f4 is going to be updated. [ 702.530548] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.531152] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.531240] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.531525] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.531684] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.539998] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c1c605b-e422-421f-b86e-88a41bb1f9f4 in Status: IN_PROGRESS for 2s [ 702.562450] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-442 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.562677] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-442" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.562815] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-442" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.563201] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-442" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.563532] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.563698] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.563753] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.563962] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.564215] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.564340] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 702.564498] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 702.564569] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 702.564609] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 702.564739] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 702.564815] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 702.565103] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 702.583630] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 702.583820] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 702.583934] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 702.584163] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-442" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.584443] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-e3350f29-afb5-4d33-a2a7-09760b172ca8 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.584696] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-e3350f29-afb5-4d33-a2a7-09760b172ca8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.584770] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-e3350f29-afb5-4d33-a2a7-09760b172ca8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.585078] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-e3350f29-afb5-4d33-a2a7-09760b172ca8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.585221] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3350f29-afb5-4d33-a2a7-09760b172ca8',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.702717] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e9c0048-237b-4cab-86e0-e56dce546daa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.793776] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.793972] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.794056] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.794252] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.794837] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.794837] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.794837] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.794837] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.794837] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.795139] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.795139] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 053f53ee-d0a4-4067-829d-5dc886808f18 is going to be updated. [ 702.821678] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.821759] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.821887] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.823285] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.823285] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.830984] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 053f53ee-d0a4-4067-829d-5dc886808f18 in Status: IN_PROGRESS for 2s [ 703.089287] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.089287] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.089287] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.089287] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.089287] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.089287] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port e3350f29-afb5-4d33-a2a7-09760b172ca8 not found, creating... [ 703.089956] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.089956] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.089956] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.089956] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.089956] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.090309] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.090583] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.090689] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.090882] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.091401] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.091401] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: e3350f29-afb5-4d33-a2a7-09760b172ca8 is going to be created. [ 703.109974] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.110304] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.110719] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.110836] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.112113] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.112113] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-e3350f29-afb5-4d33-a2a7-09760b172ca8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.207363] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e9c0048-237b-4cab-86e0-e56dce546daa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.601984] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0695687-32e8-4e4a-a8c8-31e6c3709596 in Status: SUCCESS [ 703.602071] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0695687-32e8-4e4a-a8c8-31e6c3709596" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.710988] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.711168] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.711245] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.711559] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.711669] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.711758] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e9c0048-237b-4cab-86e0-e56dce546daa is going to be updated. [ 703.741376] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.741919] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.742073] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.743062] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.744199] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.752868] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e9c0048-237b-4cab-86e0-e56dce546daa in Status: IN_PROGRESS for 2s [ 703.874055] env[70764]: INFO networking_nsxv3.common.synchronization [req-78778e89-c24f-4fb1-939e-0c9ee2030abf req-be82ef3f-fb87-495b-b682-2206525131ff service nova] Enqueued Resource ID: 5e9c0048-237b-4cab-86e0-e56dce546daa with Priority: HIGHEST for action security_group_rules [ 703.874310] env[70764]: INFO networking_nsxv3.common.synchronization [req-78778e89-c24f-4fb1-939e-0c9ee2030abf req-be82ef3f-fb87-495b-b682-2206525131ff service nova] Enqueued Resource ID: 5e9c0048-237b-4cab-86e0-e56dce546daa with Priority: HIGHEST for action security_group_members [ 703.874470] env[70764]: INFO networking_nsxv3.common.synchronization [req-78778e89-c24f-4fb1-939e-0c9ee2030abf req-be82ef3f-fb87-495b-b682-2206525131ff service nova] Enqueued Resource ID: e3350f29-afb5-4d33-a2a7-09760b172ca8 with Priority: HIGHEST for action port [ 703.876352] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e9c0048-237b-4cab-86e0-e56dce546daa with Priority: HIGHEST for action security_group_rules [ 703.876531] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e9c0048-237b-4cab-86e0-e56dce546daa with Priority: HIGHEST for action security_group_members [ 703.876641] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3350f29-afb5-4d33-a2a7-09760b172ca8 with Priority: HIGHEST for action port [ 703.876997] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e9c0048-237b-4cab-86e0-e56dce546daa taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.877185] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.877226] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.877431] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.877532] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e9c0048-237b-4cab-86e0-e56dce546daa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.879822] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e9c0048-237b-4cab-86e0-e56dce546daa taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.879934] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.883224] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3350f29-afb5-4d33-a2a7-09760b172ca8 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.883224] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3350f29-afb5-4d33-a2a7-09760b172ca8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.883224] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3350f29-afb5-4d33-a2a7-09760b172ca8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.883224] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3350f29-afb5-4d33-a2a7-09760b172ca8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.883224] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3350f29-afb5-4d33-a2a7-09760b172ca8',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.385033] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e9c0048-237b-4cab-86e0-e56dce546daa taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.385342] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.385389] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e3350f29-afb5-4d33-a2a7-09760b172ca8 with status ACTIVE [ 704.385775] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.385775] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.385919] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.386565] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.386565] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.386565] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.386565] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.386565] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.386565] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.386837] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.386837] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.386916] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.386916] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.387068] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.387142] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.387224] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e3350f29-afb5-4d33-a2a7-09760b172ca8 is going to be updated. [ 704.418414] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.418625] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.418723] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.418953] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.419140] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.419337] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3350f29-afb5-4d33-a2a7-09760b172ca8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.550279] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c1c605b-e422-421f-b86e-88a41bb1f9f4 in Status: SUCCESS [ 704.550659] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c1c605b-e422-421f-b86e-88a41bb1f9f4 deletion is rescheduled due to dependency. [ 704.550659] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c1c605b-e422-421f-b86e-88a41bb1f9f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.842688] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 053f53ee-d0a4-4067-829d-5dc886808f18 in Status: SUCCESS [ 704.842868] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 053f53ee-d0a4-4067-829d-5dc886808f18 deletion is rescheduled due to dependency. [ 704.842983] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.764583] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e9c0048-237b-4cab-86e0-e56dce546daa in Status: SUCCESS [ 705.764895] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.765017] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.765779] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.765779] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.765779] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.765779] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.766071] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.766071] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.766201] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e9c0048-237b-4cab-86e0-e56dce546daa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.270821] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e9c0048-237b-4cab-86e0-e56dce546daa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.774992] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e9c0048-237b-4cab-86e0-e56dce546daa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.281528] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.281528] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.281528] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.281528] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.281528] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.281528] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e9c0048-237b-4cab-86e0-e56dce546daa is going to be updated. [ 707.309487] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.309645] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.309804] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.309954] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.310189] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.321395] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e9c0048-237b-4cab-86e0-e56dce546daa in Status: IN_PROGRESS for 2s [ 707.595640] env[70764]: INFO networking_nsxv3.common.synchronization [None req-b9c92448-8642-4398-a55f-72b292254f23 None None] Enqueued Resource ID: 55702770-d1b4-428a-9ab9-df02708b1349 with Priority: HIGHEST for action port [ 707.596292] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55702770-d1b4-428a-9ab9-df02708b1349 with Priority: HIGHEST for action port [ 707.596603] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-55702770-d1b4-428a-9ab9-df02708b1349 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.596734] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55702770-d1b4-428a-9ab9-df02708b1349" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.596787] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55702770-d1b4-428a-9ab9-df02708b1349" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.597049] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55702770-d1b4-428a-9ab9-df02708b1349" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.597137] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55702770-d1b4-428a-9ab9-df02708b1349',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.099372] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 55702770-d1b4-428a-9ab9-df02708b1349 [ 708.099764] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.099764] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.099951] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.100066] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.100263] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.100263] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:55702770-d1b4-428a-9ab9-df02708b1349 already deleted. [ 708.100386] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55702770-d1b4-428a-9ab9-df02708b1349" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.520380] env[70764]: INFO networking_nsxv3.common.synchronization [req-2f44e452-3f5f-4148-ba42-b1745ed0764d req-9f0309b6-17cf-4004-98b1-5700440242fd tempest-ServerGroupTestJSON-1869869452 tempest-ServerGroupTestJSON-1869869452-project-member] Enqueued Resource ID: 48f2ee72-0aec-44b3-967c-055925852aa5 with Priority: HIGHEST for action security_group_members [ 708.520836] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48f2ee72-0aec-44b3-967c-055925852aa5 with Priority: HIGHEST for action security_group_members [ 708.521155] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-48f2ee72-0aec-44b3-967c-055925852aa5 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.521283] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48f2ee72-0aec-44b3-967c-055925852aa5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.521448] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48f2ee72-0aec-44b3-967c-055925852aa5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.521570] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48f2ee72-0aec-44b3-967c-055925852aa5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.521758] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.521830] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.521880] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.522048] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.522104] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.522203] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48f2ee72-0aec-44b3-967c-055925852aa5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.024801] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.024801] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.025099] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.025791] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.025791] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.025954] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.026058] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.026156] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.026379] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.026505] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.026615] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48f2ee72-0aec-44b3-967c-055925852aa5 is going to be updated. [ 709.055207] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.055207] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.055207] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.055207] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.055207] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.075668] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48f2ee72-0aec-44b3-967c-055925852aa5 in Status: IN_PROGRESS for 2s [ 709.332626] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e9c0048-237b-4cab-86e0-e56dce546daa in Status: SUCCESS [ 709.332626] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.333026] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.333109] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.333299] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.333417] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.333483] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.333642] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.333819] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.333819] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.333912] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e9c0048-237b-4cab-86e0-e56dce546daa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.840125] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e9c0048-237b-4cab-86e0-e56dce546daa taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.840125] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.840125] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.840125] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.840125] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.840125] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.840125] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.840125] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.840125] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.840125] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.840125] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e9c0048-237b-4cab-86e0-e56dce546daa taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.840125] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.840125] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.840125] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.840125] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.840125] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.840824] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.840824] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.840824] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.840824] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.840824] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e9c0048-237b-4cab-86e0-e56dce546daa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.951748] env[70764]: INFO networking_nsxv3.common.synchronization [None req-aab98263-b49b-4bf4-b16f-a8be4d4b7dce None None] Enqueued Resource ID: 6b4dc12b-7fb9-445c-b4b8-cfd3f811a23c with Priority: HIGHEST for action port [ 709.952044] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b4dc12b-7fb9-445c-b4b8-cfd3f811a23c with Priority: HIGHEST for action port [ 709.952078] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b4dc12b-7fb9-445c-b4b8-cfd3f811a23c taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.952215] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b4dc12b-7fb9-445c-b4b8-cfd3f811a23c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.952282] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b4dc12b-7fb9-445c-b4b8-cfd3f811a23c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.953033] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b4dc12b-7fb9-445c-b4b8-cfd3f811a23c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.953033] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b4dc12b-7fb9-445c-b4b8-cfd3f811a23c',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.344701] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e9c0048-237b-4cab-86e0-e56dce546daa: rpc.has_security_group_logging(os_id): False [ 710.369051] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.369051] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.369051] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.369051] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.369051] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.369051] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.369051] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.369051] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.369051] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.369051] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.369051] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.369051] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.369051] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.369051] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.369051] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.369612] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.369612] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.369612] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.369612] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.369612] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.369612] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e9c0048-237b-4cab-86e0-e56dce546daa is going to be updated. [ 710.428466] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.428628] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.428698] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.428910] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.429064] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.443505] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e9c0048-237b-4cab-86e0-e56dce546daa in Status: IN_PROGRESS for 2s [ 710.455766] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6b4dc12b-7fb9-445c-b4b8-cfd3f811a23c [ 710.456042] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.456152] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.456224] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.456433] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.456525] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.456621] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6b4dc12b-7fb9-445c-b4b8-cfd3f811a23c already deleted. [ 710.456704] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b4dc12b-7fb9-445c-b4b8-cfd3f811a23c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.086080] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48f2ee72-0aec-44b3-967c-055925852aa5 in Status: SUCCESS [ 711.091538] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48f2ee72-0aec-44b3-967c-055925852aa5 deletion is rescheduled due to dependency. [ 711.091538] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48f2ee72-0aec-44b3-967c-055925852aa5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.457299] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e9c0048-237b-4cab-86e0-e56dce546daa in Status: SUCCESS [ 712.457678] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.088626] env[70764]: INFO networking_nsxv3.common.synchronization [req-609adb34-350b-4442-9720-d63168b65cf4 req-af7b6c1e-17aa-438f-89c1-5f0f27f75be5 tempest-AttachInterfacesUnderV243Test-1674775708 tempest-AttachInterfacesUnderV243Test-1674775708-project-member] Enqueued Resource ID: 83d2b431-6671-4f07-b09d-39da26e77cad with Priority: HIGHEST for action security_group_members [ 713.088626] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83d2b431-6671-4f07-b09d-39da26e77cad with Priority: HIGHEST for action security_group_members [ 713.088626] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-83d2b431-6671-4f07-b09d-39da26e77cad taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.088947] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.088947] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.090037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.090037] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.090037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.090037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.090037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.090037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.090037] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83d2b431-6671-4f07-b09d-39da26e77cad',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.141904] env[70764]: INFO networking_nsxv3.common.synchronization [req-609adb34-350b-4442-9720-d63168b65cf4 req-af7b6c1e-17aa-438f-89c1-5f0f27f75be5 tempest-AttachInterfacesUnderV243Test-1674775708 tempest-AttachInterfacesUnderV243Test-1674775708-project-member] Enqueued Resource ID: 83d2b431-6671-4f07-b09d-39da26e77cad with Priority: HIGHEST for action security_group_rules [ 713.142115] env[70764]: INFO networking_nsxv3.common.synchronization [req-609adb34-350b-4442-9720-d63168b65cf4 req-af7b6c1e-17aa-438f-89c1-5f0f27f75be5 tempest-AttachInterfacesUnderV243Test-1674775708 tempest-AttachInterfacesUnderV243Test-1674775708-project-member] Enqueued Resource ID: 83d2b431-6671-4f07-b09d-39da26e77cad with Priority: HIGHEST for action security_group_members [ 713.142264] env[70764]: INFO networking_nsxv3.common.synchronization [req-609adb34-350b-4442-9720-d63168b65cf4 req-af7b6c1e-17aa-438f-89c1-5f0f27f75be5 tempest-AttachInterfacesUnderV243Test-1674775708 tempest-AttachInterfacesUnderV243Test-1674775708-project-member] Enqueued Resource ID: d57d3f51-44e0-4cf8-94f1-5ace0266534d with Priority: HIGHEST for action port [ 713.142791] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83d2b431-6671-4f07-b09d-39da26e77cad with Priority: HIGHEST for action security_group_rules [ 713.142932] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83d2b431-6671-4f07-b09d-39da26e77cad with Priority: HIGHEST for action security_group_members [ 713.144228] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d57d3f51-44e0-4cf8-94f1-5ace0266534d with Priority: HIGHEST for action port [ 713.144228] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83d2b431-6671-4f07-b09d-39da26e77cad taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.144228] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.144228] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.144228] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.144228] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83d2b431-6671-4f07-b09d-39da26e77cad',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.145085] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-83d2b431-6671-4f07-b09d-39da26e77cad taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.145261] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.145505] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-d57d3f51-44e0-4cf8-94f1-5ace0266534d taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.145948] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d57d3f51-44e0-4cf8-94f1-5ace0266534d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.145948] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d57d3f51-44e0-4cf8-94f1-5ace0266534d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.145948] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d57d3f51-44e0-4cf8-94f1-5ace0266534d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.145948] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d57d3f51-44e0-4cf8-94f1-5ace0266534d',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.595344] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('83d2b431-6671-4f07-b09d-39da26e77cad',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.613974] env[70764]: INFO networking_nsxv3.common.synchronization [None req-97037549-0105-4358-bcd2-c4b9a81f47a4 None None] Enqueued Resource ID: 1a07c674-a10b-4da7-bed0-d0eba40c15f1 with Priority: HIGHEST for action port [ 713.614102] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a07c674-a10b-4da7-bed0-d0eba40c15f1 with Priority: HIGHEST for action port [ 713.614678] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a07c674-a10b-4da7-bed0-d0eba40c15f1 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.614819] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a07c674-a10b-4da7-bed0-d0eba40c15f1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.614874] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a07c674-a10b-4da7-bed0-d0eba40c15f1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.615153] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a07c674-a10b-4da7-bed0-d0eba40c15f1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.615206] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a07c674-a10b-4da7-bed0-d0eba40c15f1',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.648388] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-83d2b431-6671-4f07-b09d-39da26e77cad taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.648565] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.648800] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d57d3f51-44e0-4cf8-94f1-5ace0266534d with status ACTIVE [ 713.649045] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.649208] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.649298] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.649583] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.649698] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.649923] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.650054] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.650133] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.650349] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.650423] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.650670] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.650789] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.650857] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.651010] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.651135] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.651219] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d57d3f51-44e0-4cf8-94f1-5ace0266534d is going to be updated. [ 713.672792] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.672792] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.672972] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.673046] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.673201] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.673360] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d57d3f51-44e0-4cf8-94f1-5ace0266534d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.097964] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('83d2b431-6671-4f07-b09d-39da26e77cad',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.121082] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1a07c674-a10b-4da7-bed0-d0eba40c15f1 [ 714.121403] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.121619] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.121732] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.121984] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.122168] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.122303] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1a07c674-a10b-4da7-bed0-d0eba40c15f1 already deleted. [ 714.122419] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a07c674-a10b-4da7-bed0-d0eba40c15f1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.600463] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.600835] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.600835] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.601687] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.601687] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.601687] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83d2b431-6671-4f07-b09d-39da26e77cad is going to be updated. [ 714.631022] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.631022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.631022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.631022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.631022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.638782] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83d2b431-6671-4f07-b09d-39da26e77cad in Status: IN_PROGRESS for 2s [ 715.226249] env[70764]: INFO networking_nsxv3.common.synchronization [None req-673211d5-2dbe-4396-a711-d40d4330d02f tempest-ImagesOneServerNegativeTestJSON-1318507346 tempest-ImagesOneServerNegativeTestJSON-1318507346-project-member] Enqueued Resource ID: b888dc0b-55f9-450b-806e-0cf35d41402a with Priority: HIGHEST for action security_group_rules [ 715.226249] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b888dc0b-55f9-450b-806e-0cf35d41402a with Priority: HIGHEST for action security_group_rules [ 715.226249] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b888dc0b-55f9-450b-806e-0cf35d41402a taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.226249] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b888dc0b-55f9-450b-806e-0cf35d41402a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.226249] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b888dc0b-55f9-450b-806e-0cf35d41402a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.226249] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b888dc0b-55f9-450b-806e-0cf35d41402a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.226249] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b888dc0b-55f9-450b-806e-0cf35d41402a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.299166] env[70764]: INFO networking_nsxv3.common.synchronization [None req-68430792-c30a-4009-a6b7-48e237d3e4dc tempest-ImagesOneServerNegativeTestJSON-1318507346 tempest-ImagesOneServerNegativeTestJSON-1318507346-project-member] Enqueued Resource ID: b888dc0b-55f9-450b-806e-0cf35d41402a with Priority: HIGHEST for action security_group_rules [ 715.299458] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b888dc0b-55f9-450b-806e-0cf35d41402a with Priority: HIGHEST for action security_group_rules [ 715.303018] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b888dc0b-55f9-450b-806e-0cf35d41402a taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.303018] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b888dc0b-55f9-450b-806e-0cf35d41402a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.749148] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.749148] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.749148] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.749148] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.749148] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.749148] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b888dc0b-55f9-450b-806e-0cf35d41402a already deleted. [ 715.749148] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b888dc0b-55f9-450b-806e-0cf35d41402a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.749148] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b888dc0b-55f9-450b-806e-0cf35d41402a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.749148] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b888dc0b-55f9-450b-806e-0cf35d41402a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.749148] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b888dc0b-55f9-450b-806e-0cf35d41402a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.774538] env[70764]: INFO networking_nsxv3.common.synchronization [None req-cb4da4db-87f9-4e5f-8b6f-d501dfdc846d None None] Enqueued Resource ID: e978bf76-64a5-44e2-9c35-f998c018b1d6 with Priority: HIGHEST for action port [ 715.775064] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e978bf76-64a5-44e2-9c35-f998c018b1d6 with Priority: HIGHEST for action port [ 715.775370] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-e978bf76-64a5-44e2-9c35-f998c018b1d6 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.775493] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e978bf76-64a5-44e2-9c35-f998c018b1d6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.775562] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e978bf76-64a5-44e2-9c35-f998c018b1d6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.775806] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e978bf76-64a5-44e2-9c35-f998c018b1d6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.775889] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e978bf76-64a5-44e2-9c35-f998c018b1d6',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.273195] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.273457] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.273457] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.273767] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.273767] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.273857] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b888dc0b-55f9-450b-806e-0cf35d41402a already deleted. [ 716.273891] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b888dc0b-55f9-450b-806e-0cf35d41402a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.278329] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e978bf76-64a5-44e2-9c35-f998c018b1d6 [ 716.278536] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.278717] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.278895] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.279020] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.281248] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.281381] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e978bf76-64a5-44e2-9c35-f998c018b1d6 already deleted. [ 716.281471] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e978bf76-64a5-44e2-9c35-f998c018b1d6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.648413] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83d2b431-6671-4f07-b09d-39da26e77cad in Status: SUCCESS [ 716.648645] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.648812] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.649041] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.649237] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.650378] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.650378] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.650378] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.650378] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.650378] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83d2b431-6671-4f07-b09d-39da26e77cad',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.906026] env[70764]: INFO networking_nsxv3.common.synchronization [req-64ad422a-8fc9-4996-a325-9040a49c9ec7 req-1ae0f6e2-d051-454d-8b02-06e945de2fa4 tempest-AttachInterfacesUnderV243Test-1674775708 tempest-AttachInterfacesUnderV243Test-1674775708-project-member] Enqueued Resource ID: 83d2b431-6671-4f07-b09d-39da26e77cad with Priority: HIGHEST for action security_group_members [ 716.906702] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83d2b431-6671-4f07-b09d-39da26e77cad with Priority: HIGHEST for action security_group_members [ 716.907055] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-83d2b431-6671-4f07-b09d-39da26e77cad taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.907192] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.941097] env[70764]: INFO networking_nsxv3.common.synchronization [req-64ad422a-8fc9-4996-a325-9040a49c9ec7 req-1ae0f6e2-d051-454d-8b02-06e945de2fa4 tempest-AttachInterfacesUnderV243Test-1674775708 tempest-AttachInterfacesUnderV243Test-1674775708-project-member] Enqueued Resource ID: 83d2b431-6671-4f07-b09d-39da26e77cad with Priority: HIGHEST for action security_group_rules [ 716.941280] env[70764]: INFO networking_nsxv3.common.synchronization [req-64ad422a-8fc9-4996-a325-9040a49c9ec7 req-1ae0f6e2-d051-454d-8b02-06e945de2fa4 tempest-AttachInterfacesUnderV243Test-1674775708 tempest-AttachInterfacesUnderV243Test-1674775708-project-member] Enqueued Resource ID: 83d2b431-6671-4f07-b09d-39da26e77cad with Priority: HIGHEST for action security_group_members [ 716.942940] env[70764]: INFO networking_nsxv3.common.synchronization [req-64ad422a-8fc9-4996-a325-9040a49c9ec7 req-1ae0f6e2-d051-454d-8b02-06e945de2fa4 tempest-AttachInterfacesUnderV243Test-1674775708 tempest-AttachInterfacesUnderV243Test-1674775708-project-member] Enqueued Resource ID: d57d3f51-44e0-4cf8-94f1-5ace0266534d with Priority: HIGHEST for action port [ 716.943771] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83d2b431-6671-4f07-b09d-39da26e77cad with Priority: HIGHEST for action security_group_rules [ 716.943947] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83d2b431-6671-4f07-b09d-39da26e77cad with Priority: HIGHEST for action security_group_members [ 716.944135] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d57d3f51-44e0-4cf8-94f1-5ace0266534d with Priority: HIGHEST for action port [ 716.944446] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83d2b431-6671-4f07-b09d-39da26e77cad taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.944702] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.945025] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-83d2b431-6671-4f07-b09d-39da26e77cad taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.945155] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.945409] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-d57d3f51-44e0-4cf8-94f1-5ace0266534d taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.945843] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d57d3f51-44e0-4cf8-94f1-5ace0266534d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.946510] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d57d3f51-44e0-4cf8-94f1-5ace0266534d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.946766] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d57d3f51-44e0-4cf8-94f1-5ace0266534d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.948169] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d57d3f51-44e0-4cf8-94f1-5ace0266534d',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.153562] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('83d2b431-6671-4f07-b09d-39da26e77cad',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.450687] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d57d3f51-44e0-4cf8-94f1-5ace0266534d with status ACTIVE [ 717.450961] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.451182] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.451263] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.451478] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.451620] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.452205] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.452205] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.452205] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.452351] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.452351] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.452587] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.452736] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.452800] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.452951] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.453037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.453188] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d57d3f51-44e0-4cf8-94f1-5ace0266534d is going to be updated. [ 717.472542] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.472678] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.472752] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.473036] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.473182] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.473345] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d57d3f51-44e0-4cf8-94f1-5ace0266534d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.655578] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('83d2b431-6671-4f07-b09d-39da26e77cad',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.158736] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.159020] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.159020] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.159259] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.159353] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.159612] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83d2b431-6671-4f07-b09d-39da26e77cad is going to be updated. [ 718.184959] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.185364] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.185364] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.185364] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.185524] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.197499] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83d2b431-6671-4f07-b09d-39da26e77cad in Status: IN_PROGRESS for 2s [ 720.206413] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83d2b431-6671-4f07-b09d-39da26e77cad in Status: SUCCESS [ 720.206678] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.206813] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.207118] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.207332] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.207474] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.207543] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.207723] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.207822] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.207936] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.208074] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('83d2b431-6671-4f07-b09d-39da26e77cad',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.208938] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.209136] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.209306] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.209424] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.209489] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.209645] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.209727] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.209817] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83d2b431-6671-4f07-b09d-39da26e77cad',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.249940] env[70764]: INFO networking_nsxv3.common.synchronization [req-12ff9f8a-7fe8-4a02-b99e-f32b206c7f6c req-02cc7dfe-5396-4615-8341-3d41439b30f1 tempest-ServersTestJSON-88830314 tempest-ServersTestJSON-88830314-project-member] Enqueued Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_members [ 720.250592] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_members [ 720.251319] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.251319] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.251319] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.251552] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.251552] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.251635] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.251665] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.252155] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.252155] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.252155] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.711800] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('83d2b431-6671-4f07-b09d-39da26e77cad',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.717280] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('83d2b431-6671-4f07-b09d-39da26e77cad',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.755365] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.813030] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-603 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.813340] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-603" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.813485] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-603" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.813752] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-603" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.814023] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.814183] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.814298] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.814507] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.814649] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.814855] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 720.814967] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 720.816420] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 720.816571] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 720.816696] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 720.816811] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 720.816942] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 720.835151] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 720.835579] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 720.835621] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 720.836429] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-603" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.836988] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-140ea0ca-27a6-4973-84d5-c3b917b36303 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.836988] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-140ea0ca-27a6-4973-84d5-c3b917b36303" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.837145] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-140ea0ca-27a6-4973-84d5-c3b917b36303" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.837585] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-140ea0ca-27a6-4973-84d5-c3b917b36303" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.837585] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('140ea0ca-27a6-4973-84d5-c3b917b36303',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.010999] env[70764]: INFO networking_nsxv3.common.synchronization [req-3830b0c6-355b-4779-a6b2-9a99b56c5a72 req-375eb2e8-bb74-4e5c-ad38-2ad5ee5d12e0 tempest-AttachInterfacesUnderV243Test-1674775708 tempest-AttachInterfacesUnderV243Test-1674775708-project-member] Enqueued Resource ID: 83d2b431-6671-4f07-b09d-39da26e77cad with Priority: HIGHEST for action security_group_members [ 721.010999] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83d2b431-6671-4f07-b09d-39da26e77cad with Priority: HIGHEST for action security_group_members [ 721.010999] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-83d2b431-6671-4f07-b09d-39da26e77cad taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.010999] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.219405] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 83d2b431-6671-4f07-b09d-39da26e77cad: rpc.has_security_group_logging(os_id): False [ 721.220628] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('83d2b431-6671-4f07-b09d-39da26e77cad',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.238189] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.238336] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.238407] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.238679] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.238788] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.239084] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.239209] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.239254] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.239415] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.239492] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.239598] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83d2b431-6671-4f07-b09d-39da26e77cad is going to be updated. [ 721.258206] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.297696] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.297878] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.297923] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.298136] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.298282] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.309501] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83d2b431-6671-4f07-b09d-39da26e77cad in Status: IN_PROGRESS for 2s [ 721.339809] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.340116] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.340247] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.340649] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.340820] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.341548] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 140ea0ca-27a6-4973-84d5-c3b917b36303 not found, creating... [ 721.341548] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.341689] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.341982] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.342159] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.342345] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.342714] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.342984] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.343110] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.343382] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.343593] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.343787] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 140ea0ca-27a6-4973-84d5-c3b917b36303 is going to be created. [ 721.376945] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.377195] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.377322] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.377585] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.377797] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.378036] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-140ea0ca-27a6-4973-84d5-c3b917b36303" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.724028] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.724028] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.724028] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.724268] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.724268] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.724426] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83d2b431-6671-4f07-b09d-39da26e77cad is going to be updated. [ 721.750474] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.750646] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.750718] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.750924] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.751107] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.758508] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83d2b431-6671-4f07-b09d-39da26e77cad in Status: IN_PROGRESS for 2s [ 721.759924] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.760056] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.760123] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.760311] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.760397] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.760489] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8f5efec-a14e-4be6-8add-7b35a995c982 is going to be updated. [ 721.785382] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.785382] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.785382] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.785559] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.785771] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.793215] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: IN_PROGRESS for 2s [ 722.457599] env[70764]: INFO networking_nsxv3.common.synchronization [req-12ff9f8a-7fe8-4a02-b99e-f32b206c7f6c req-9298661e-18ca-4fda-bc41-ac0965ba5ec0 service nova] Enqueued Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_rules [ 722.457793] env[70764]: INFO networking_nsxv3.common.synchronization [req-12ff9f8a-7fe8-4a02-b99e-f32b206c7f6c req-9298661e-18ca-4fda-bc41-ac0965ba5ec0 service nova] Enqueued Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_members [ 722.457897] env[70764]: INFO networking_nsxv3.common.synchronization [req-12ff9f8a-7fe8-4a02-b99e-f32b206c7f6c req-9298661e-18ca-4fda-bc41-ac0965ba5ec0 service nova] Enqueued Resource ID: 140ea0ca-27a6-4973-84d5-c3b917b36303 with Priority: HIGHEST for action port [ 722.458150] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_rules [ 722.458280] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_members [ 722.458377] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 140ea0ca-27a6-4973-84d5-c3b917b36303 with Priority: HIGHEST for action port [ 722.459602] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.459730] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.459797] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.459999] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.460096] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.461339] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.461454] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.461624] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-140ea0ca-27a6-4973-84d5-c3b917b36303 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.461723] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-140ea0ca-27a6-4973-84d5-c3b917b36303" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.461788] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-140ea0ca-27a6-4973-84d5-c3b917b36303" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.461955] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-140ea0ca-27a6-4973-84d5-c3b917b36303" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.462046] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('140ea0ca-27a6-4973-84d5-c3b917b36303',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.932125] env[70764]: INFO networking_nsxv3.common.synchronization [req-2ed6beaf-c2ef-46d6-aa4c-9d51c2972b43 req-494bebee-029a-4899-8f9a-3ea3a225c088 tempest-ImagesTestJSON-1647743380 tempest-ImagesTestJSON-1647743380-project-member] Enqueued Resource ID: 4580d502-1d18-4681-96a4-28ac4e291d69 with Priority: HIGHEST for action security_group_members [ 722.932125] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4580d502-1d18-4681-96a4-28ac4e291d69 with Priority: HIGHEST for action security_group_members [ 722.932125] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4580d502-1d18-4681-96a4-28ac4e291d69 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.932125] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.932125] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.932125] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.932552] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.932822] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.932989] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.933260] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.933455] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.933646] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4580d502-1d18-4681-96a4-28ac4e291d69',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.961719] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.961719] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.968030] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 140ea0ca-27a6-4973-84d5-c3b917b36303 with status ACTIVE [ 722.968030] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.968030] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.968030] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.968030] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.968030] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.968030] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.968030] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.968030] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.968030] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.968030] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.968030] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.968030] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.968030] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.968030] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.968030] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.968030] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 140ea0ca-27a6-4973-84d5-c3b917b36303 is going to be updated. [ 722.988111] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.988111] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.988111] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.988111] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.988111] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.988111] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-140ea0ca-27a6-4973-84d5-c3b917b36303" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.271694] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-828 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.271957] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-828" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.272196] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-828" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.272511] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-828" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.272832] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.273049] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.273215] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.273483] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.273671] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.273927] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 723.274091] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 723.274575] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 723.274575] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 723.274575] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 723.274727] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 723.274788] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 723.291986] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 723.292215] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 723.292375] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 723.292592] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-828" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.292949] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-183fd1d6-5b34-4757-ac2a-1ed0cb780847 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.293200] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-183fd1d6-5b34-4757-ac2a-1ed0cb780847" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.293359] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-183fd1d6-5b34-4757-ac2a-1ed0cb780847" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.293949] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-183fd1d6-5b34-4757-ac2a-1ed0cb780847" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.293949] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('183fd1d6-5b34-4757-ac2a-1ed0cb780847',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.322799] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83d2b431-6671-4f07-b09d-39da26e77cad in Status: SUCCESS [ 723.323658] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.323872] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.324141] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.324261] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83d2b431-6671-4f07-b09d-39da26e77cad',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.436642] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.436713] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.436783] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.436975] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.437082] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.437300] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.437389] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.437452] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.437609] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.437683] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.437829] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4580d502-1d18-4681-96a4-28ac4e291d69 already deleted. [ 723.437898] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.767430] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83d2b431-6671-4f07-b09d-39da26e77cad in Status: SUCCESS [ 723.767683] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.767817] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.768049] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.768245] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.768361] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.768429] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.768584] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.768666] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.768760] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83d2b431-6671-4f07-b09d-39da26e77cad',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.797620] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.797785] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.797910] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.798195] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.798343] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.798492] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 183fd1d6-5b34-4757-ac2a-1ed0cb780847 not found, creating... [ 723.798749] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.798907] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.799032] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.799469] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.799469] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.799788] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.799982] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.800136] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.800350] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.800487] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.801826] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 183fd1d6-5b34-4757-ac2a-1ed0cb780847 is going to be created. [ 723.802234] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: SUCCESS [ 723.802419] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.802576] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.802732] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.802884] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.802983] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.803075] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.803229] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.803306] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.803398] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.826696] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.826696] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.826696] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.826696] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.826696] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.826696] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-183fd1d6-5b34-4757-ac2a-1ed0cb780847" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.930269] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.930269] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.930269] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.930269] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.930269] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.930269] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83d2b431-6671-4f07-b09d-39da26e77cad is going to be deleted. [ 724.021505] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.021673] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.021718] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.021912] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.022009] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.022141] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.274298] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.274486] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.274570] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.274816] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.274927] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.275275] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.275275] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.275390] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.275525] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.275605] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.275716] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83d2b431-6671-4f07-b09d-39da26e77cad is going to be deleted. [ 724.305168] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.315053] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.315204] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.315271] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.315479] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.319301] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.319341] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.319826] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.320035] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.320219] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.320327] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.320389] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.320555] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.320647] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.320742] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83d2b431-6671-4f07-b09d-39da26e77cad',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.672176] env[70764]: INFO networking_nsxv3.common.synchronization [req-2ed6beaf-c2ef-46d6-aa4c-9d51c2972b43 req-12eac06f-2908-45ff-9361-df36ad1f5c58 service nova] Enqueued Resource ID: 4580d502-1d18-4681-96a4-28ac4e291d69 with Priority: HIGHEST for action security_group_rules [ 724.672365] env[70764]: INFO networking_nsxv3.common.synchronization [req-2ed6beaf-c2ef-46d6-aa4c-9d51c2972b43 req-12eac06f-2908-45ff-9361-df36ad1f5c58 service nova] Enqueued Resource ID: 4580d502-1d18-4681-96a4-28ac4e291d69 with Priority: HIGHEST for action security_group_members [ 724.672547] env[70764]: INFO networking_nsxv3.common.synchronization [req-2ed6beaf-c2ef-46d6-aa4c-9d51c2972b43 req-12eac06f-2908-45ff-9361-df36ad1f5c58 service nova] Enqueued Resource ID: 183fd1d6-5b34-4757-ac2a-1ed0cb780847 with Priority: HIGHEST for action port [ 724.673046] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4580d502-1d18-4681-96a4-28ac4e291d69 with Priority: HIGHEST for action security_group_rules [ 724.673184] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4580d502-1d18-4681-96a4-28ac4e291d69 with Priority: HIGHEST for action security_group_members [ 724.673281] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 183fd1d6-5b34-4757-ac2a-1ed0cb780847 with Priority: HIGHEST for action port [ 724.673552] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4580d502-1d18-4681-96a4-28ac4e291d69 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.673685] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.673753] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.673994] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.674264] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4580d502-1d18-4681-96a4-28ac4e291d69',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.675279] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4580d502-1d18-4681-96a4-28ac4e291d69 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.675279] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.675279] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.675537] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.675718] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.675839] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.675919] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.676095] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.676224] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.676338] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4580d502-1d18-4681-96a4-28ac4e291d69',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.677377] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-183fd1d6-5b34-4757-ac2a-1ed0cb780847 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.677569] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-183fd1d6-5b34-4757-ac2a-1ed0cb780847" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.677569] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-183fd1d6-5b34-4757-ac2a-1ed0cb780847" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.677766] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-183fd1d6-5b34-4757-ac2a-1ed0cb780847" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.677874] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('183fd1d6-5b34-4757-ac2a-1ed0cb780847',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.807854] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.823107] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.823327] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.823697] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.823920] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.824031] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.824264] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.824372] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.824467] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.824618] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.824722] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.824815] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83d2b431-6671-4f07-b09d-39da26e77cad already deleted. [ 724.824898] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83d2b431-6671-4f07-b09d-39da26e77cad" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.179768] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4580d502-1d18-4681-96a4-28ac4e291d69',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.180446] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4580d502-1d18-4681-96a4-28ac4e291d69 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.180594] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.181042] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 183fd1d6-5b34-4757-ac2a-1ed0cb780847 with status ACTIVE [ 725.181226] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.181669] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.181749] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.182635] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.182635] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.182635] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.182635] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.182635] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.182635] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.182635] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.182933] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.182933] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.183014] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.183350] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.183350] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.183350] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 183fd1d6-5b34-4757-ac2a-1ed0cb780847 is going to be updated. [ 725.211097] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.211097] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.211097] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.211097] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.211097] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.211097] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-183fd1d6-5b34-4757-ac2a-1ed0cb780847" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.311908] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.311908] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.311908] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.311908] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.311908] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.311908] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8f5efec-a14e-4be6-8add-7b35a995c982 is going to be updated. [ 725.344866] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.345688] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.346091] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.350115] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.350115] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.357727] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: IN_PROGRESS for 2s [ 725.681782] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4580d502-1d18-4681-96a4-28ac4e291d69',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.186277] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.186277] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.186277] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.186277] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.186277] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.186277] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4580d502-1d18-4681-96a4-28ac4e291d69 is going to be created. [ 726.227097] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.227097] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.227097] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.227097] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.227097] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.236766] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4580d502-1d18-4681-96a4-28ac4e291d69 in Status: UNINITIALIZED for 2s [ 727.369044] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: SUCCESS [ 727.369044] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.369044] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.369501] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.369501] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.369609] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.369690] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.369836] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.369927] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.370013] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.370112] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.872367] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.872525] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.872689] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.872808] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.873668] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.873668] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.873668] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.873817] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.873817] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.873958] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.874985] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.874985] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.874985] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.874985] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.874985] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.874985] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.874985] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.874985] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.874985] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.876489] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.876489] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.247175] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4580d502-1d18-4681-96a4-28ac4e291d69 in Status: SUCCESS [ 728.247406] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.247573] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.247821] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.248042] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.248170] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.248245] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.248394] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.248485] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.248587] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.248684] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4580d502-1d18-4681-96a4-28ac4e291d69',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.378462] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f8f5efec-a14e-4be6-8add-7b35a995c982: rpc.has_security_group_logging(os_id): False [ 728.396239] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.396381] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.396979] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.396979] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.396979] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.396979] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.397176] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.397176] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.397249] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.399039] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.399039] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.399039] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.399039] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.399039] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.399039] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.399039] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.399039] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.399039] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.399039] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.399039] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.399400] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8f5efec-a14e-4be6-8add-7b35a995c982 is going to be updated. [ 728.457077] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.457219] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.457284] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.457497] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.457637] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.469284] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: IN_PROGRESS for 2s [ 728.757329] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4580d502-1d18-4681-96a4-28ac4e291d69 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.757610] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.757610] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.757776] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.758111] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.758111] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.758111] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.758251] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.758499] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.758499] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.758646] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4580d502-1d18-4681-96a4-28ac4e291d69 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.758744] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.758805] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.759519] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.759519] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.759519] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.759519] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.759519] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.759519] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.759719] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.759719] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4580d502-1d18-4681-96a4-28ac4e291d69',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.267351] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4580d502-1d18-4681-96a4-28ac4e291d69: rpc.has_security_group_logging(os_id): False [ 729.284072] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.284235] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.284299] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.284534] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.284655] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.284942] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.285327] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.285327] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.285327] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.285498] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.285532] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.286121] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.286121] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.286121] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.286121] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.286121] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.286121] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.286488] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.286488] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.286488] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.286488] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4580d502-1d18-4681-96a4-28ac4e291d69 is going to be created. [ 729.339775] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.339913] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.339913] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.340823] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.341095] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.351815] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4580d502-1d18-4681-96a4-28ac4e291d69 in Status: IN_PROGRESS for 2s [ 729.674733] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 729.675036] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 730.329835] env[70764]: INFO networking_nsxv3.common.synchronization [req-ed129c88-07de-4087-8df7-7f953dfcf824 req-ec97a17f-d00d-4acf-a92c-54c2be59638d tempest-InstanceActionsV221TestJSON-1997581410 tempest-InstanceActionsV221TestJSON-1997581410-project-member] Enqueued Resource ID: 7a2d7e17-bca4-4474-a2c6-152a257dcccd with Priority: HIGHEST for action security_group_members [ 730.330479] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a2d7e17-bca4-4474-a2c6-152a257dcccd with Priority: HIGHEST for action security_group_members [ 730.330542] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a2d7e17-bca4-4474-a2c6-152a257dcccd taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.330651] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a2d7e17-bca4-4474-a2c6-152a257dcccd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.330721] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a2d7e17-bca4-4474-a2c6-152a257dcccd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.330972] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a2d7e17-bca4-4474-a2c6-152a257dcccd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.331759] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.332045] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.332101] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.332852] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.332986] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.333128] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a2d7e17-bca4-4474-a2c6-152a257dcccd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.483611] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: SUCCESS [ 730.483611] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.835999] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.836864] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.836864] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.836864] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.836864] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.836864] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.837159] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.837159] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.837159] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.837293] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.837333] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a2d7e17-bca4-4474-a2c6-152a257dcccd already deleted. [ 730.837393] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a2d7e17-bca4-4474-a2c6-152a257dcccd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.100394] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-389 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.100577] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-389" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.100801] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-389" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.101159] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-389" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.101472] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.101685] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.101894] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.102196] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.102366] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.102634] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 731.102825] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 731.103032] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 731.103205] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 731.103388] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 731.103734] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 731.103734] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 731.126292] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 731.126292] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 731.126292] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 731.126292] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-389" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.126292] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-fe7a0006-0822-46ff-8f04-f961d53c2192 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.126292] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-fe7a0006-0822-46ff-8f04-f961d53c2192" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.126292] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-fe7a0006-0822-46ff-8f04-f961d53c2192" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.126292] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-fe7a0006-0822-46ff-8f04-f961d53c2192" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.126292] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe7a0006-0822-46ff-8f04-f961d53c2192',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.362412] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4580d502-1d18-4681-96a4-28ac4e291d69 in Status: SUCCESS [ 731.362650] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.407835] env[70764]: INFO networking_nsxv3.common.synchronization [None req-d0336256-582b-4df0-9820-fbf0627ae05d None None] Enqueued Resource ID: 3c396cd6-d866-4372-a825-5f31f5589955 with Priority: HIGHEST for action port [ 731.407835] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c396cd6-d866-4372-a825-5f31f5589955 with Priority: HIGHEST for action port [ 731.408930] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c396cd6-d866-4372-a825-5f31f5589955 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.409233] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c396cd6-d866-4372-a825-5f31f5589955" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.409390] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c396cd6-d866-4372-a825-5f31f5589955" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.409715] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c396cd6-d866-4372-a825-5f31f5589955" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.409889] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c396cd6-d866-4372-a825-5f31f5589955',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.629584] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.629798] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.629917] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.630244] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.630440] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.630607] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port fe7a0006-0822-46ff-8f04-f961d53c2192 not found, creating... [ 731.630902] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.631141] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.631243] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.631626] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.631626] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.631875] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.632054] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.632157] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.632363] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.632494] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.632632] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: fe7a0006-0822-46ff-8f04-f961d53c2192 is going to be created. [ 731.677428] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.677428] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.677428] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.677428] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.677428] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.677428] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-fe7a0006-0822-46ff-8f04-f961d53c2192" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.912319] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3c396cd6-d866-4372-a825-5f31f5589955 [ 731.912642] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.912744] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.912824] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.913094] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.913202] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.913332] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3c396cd6-d866-4372-a825-5f31f5589955 already deleted. [ 731.913437] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c396cd6-d866-4372-a825-5f31f5589955" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.547999] env[70764]: INFO networking_nsxv3.common.synchronization [req-ed129c88-07de-4087-8df7-7f953dfcf824 req-3d6c178d-84b3-4b54-b78e-37202aeba67d service nova] Enqueued Resource ID: 7a2d7e17-bca4-4474-a2c6-152a257dcccd with Priority: HIGHEST for action security_group_rules [ 732.548192] env[70764]: INFO networking_nsxv3.common.synchronization [req-ed129c88-07de-4087-8df7-7f953dfcf824 req-3d6c178d-84b3-4b54-b78e-37202aeba67d service nova] Enqueued Resource ID: 7a2d7e17-bca4-4474-a2c6-152a257dcccd with Priority: HIGHEST for action security_group_members [ 732.548331] env[70764]: INFO networking_nsxv3.common.synchronization [req-ed129c88-07de-4087-8df7-7f953dfcf824 req-3d6c178d-84b3-4b54-b78e-37202aeba67d service nova] Enqueued Resource ID: fe7a0006-0822-46ff-8f04-f961d53c2192 with Priority: HIGHEST for action port [ 732.548570] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a2d7e17-bca4-4474-a2c6-152a257dcccd with Priority: HIGHEST for action security_group_rules [ 732.548753] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a2d7e17-bca4-4474-a2c6-152a257dcccd with Priority: HIGHEST for action security_group_members [ 732.548881] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe7a0006-0822-46ff-8f04-f961d53c2192 with Priority: HIGHEST for action port [ 732.549472] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a2d7e17-bca4-4474-a2c6-152a257dcccd taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.549597] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a2d7e17-bca4-4474-a2c6-152a257dcccd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.549663] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a2d7e17-bca4-4474-a2c6-152a257dcccd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.550603] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a2d7e17-bca4-4474-a2c6-152a257dcccd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.550603] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a2d7e17-bca4-4474-a2c6-152a257dcccd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.551731] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a2d7e17-bca4-4474-a2c6-152a257dcccd taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.554567] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a2d7e17-bca4-4474-a2c6-152a257dcccd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.554567] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a2d7e17-bca4-4474-a2c6-152a257dcccd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.554567] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a2d7e17-bca4-4474-a2c6-152a257dcccd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.554567] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.554567] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.554567] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.554567] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.554567] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.554567] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a2d7e17-bca4-4474-a2c6-152a257dcccd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.557043] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe7a0006-0822-46ff-8f04-f961d53c2192 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.557043] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe7a0006-0822-46ff-8f04-f961d53c2192" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.557043] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe7a0006-0822-46ff-8f04-f961d53c2192" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.557043] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe7a0006-0822-46ff-8f04-f961d53c2192" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.557043] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe7a0006-0822-46ff-8f04-f961d53c2192',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.057459] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a2d7e17-bca4-4474-a2c6-152a257dcccd taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.057773] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a2d7e17-bca4-4474-a2c6-152a257dcccd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.059196] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fe7a0006-0822-46ff-8f04-f961d53c2192 with status ACTIVE [ 733.059478] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.059650] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.059765] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.060073] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.060215] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.060504] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.060699] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.060803] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.061058] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.061198] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.061472] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.061663] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.061712] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.061920] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.062676] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.062861] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fe7a0006-0822-46ff-8f04-f961d53c2192 is going to be updated. [ 733.065208] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a2d7e17-bca4-4474-a2c6-152a257dcccd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.085974] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.085974] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.085974] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.085974] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.085974] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.085974] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe7a0006-0822-46ff-8f04-f961d53c2192" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.567161] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a2d7e17-bca4-4474-a2c6-152a257dcccd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.907562] env[70764]: INFO networking_nsxv3.common.synchronization [None req-6e0bd5ce-e8f7-4000-bd95-7b6be2cd7f7a None None] Enqueued Resource ID: cb9e5539-f7c0-44d0-9c2a-38e9f539492f with Priority: HIGHEST for action port [ 733.908264] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb9e5539-f7c0-44d0-9c2a-38e9f539492f with Priority: HIGHEST for action port [ 733.909191] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb9e5539-f7c0-44d0-9c2a-38e9f539492f taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.909191] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb9e5539-f7c0-44d0-9c2a-38e9f539492f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.909191] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb9e5539-f7c0-44d0-9c2a-38e9f539492f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.909961] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb9e5539-f7c0-44d0-9c2a-38e9f539492f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.909961] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb9e5539-f7c0-44d0-9c2a-38e9f539492f',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.069400] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.069703] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.069703] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.069868] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.070254] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.070421] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a2d7e17-bca4-4474-a2c6-152a257dcccd is going to be created. [ 734.094072] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.094244] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.094316] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.094528] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.096407] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.103384] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a2d7e17-bca4-4474-a2c6-152a257dcccd in Status: UNINITIALIZED for 2s [ 734.436892] env[70764]: INFO networking_nsxv3.common.synchronization [None req-119e99b2-ca20-4c29-94de-0a31de14c366 None None] Enqueued Resource ID: 81302995-f99b-4ed0-954a-4884046b86f4 with Priority: HIGHEST for action port [ 734.438368] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cb9e5539-f7c0-44d0-9c2a-38e9f539492f [ 734.438368] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.438368] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.438368] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.438368] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.438368] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.438368] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cb9e5539-f7c0-44d0-9c2a-38e9f539492f already deleted. [ 734.438689] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb9e5539-f7c0-44d0-9c2a-38e9f539492f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.438689] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81302995-f99b-4ed0-954a-4884046b86f4 with Priority: HIGHEST for action port [ 734.438948] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-81302995-f99b-4ed0-954a-4884046b86f4 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.439063] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81302995-f99b-4ed0-954a-4884046b86f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.439123] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81302995-f99b-4ed0-954a-4884046b86f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.439339] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81302995-f99b-4ed0-954a-4884046b86f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.439415] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81302995-f99b-4ed0-954a-4884046b86f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.941568] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 81302995-f99b-4ed0-954a-4884046b86f4 [ 734.941568] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.942853] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.942853] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.942853] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.942853] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.942853] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:81302995-f99b-4ed0-954a-4884046b86f4 already deleted. [ 734.942853] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81302995-f99b-4ed0-954a-4884046b86f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.369041] env[70764]: INFO networking_nsxv3.common.synchronization [req-eec4916f-c619-42f6-8cd0-3071a5926d65 req-cde614cb-fb8f-4740-b6af-859a88cecf7b tempest-AttachVolumeNegativeTest-232785497 tempest-AttachVolumeNegativeTest-232785497-project-member] Enqueued Resource ID: 837be310-7b7c-4ed0-9877-3473fe63d929 with Priority: HIGHEST for action security_group_members [ 735.370816] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 837be310-7b7c-4ed0-9877-3473fe63d929 with Priority: HIGHEST for action security_group_members [ 735.371185] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-837be310-7b7c-4ed0-9877-3473fe63d929 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.371359] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-837be310-7b7c-4ed0-9877-3473fe63d929" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.371615] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-837be310-7b7c-4ed0-9877-3473fe63d929" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.371676] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-837be310-7b7c-4ed0-9877-3473fe63d929" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.371989] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.371989] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.371989] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.372153] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.372212] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.372290] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('837be310-7b7c-4ed0-9877-3473fe63d929',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.805086] env[70764]: INFO networking_nsxv3.common.synchronization [req-f9f88bfe-8fe1-469e-acc4-da442c0d2eaa req-fd668dd8-9781-447c-a80f-ff727bff90ef tempest-ServersTestJSON-88830314 tempest-ServersTestJSON-88830314-project-member] Enqueued Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_members [ 735.805936] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_members [ 735.806062] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.806199] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.806269] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.807162] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.807162] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.807162] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.807162] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.807162] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.807162] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.807162] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.874653] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.874817] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.874890] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.875144] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.875328] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.875441] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.875547] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.875611] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.875819] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.875819] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.875951] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 837be310-7b7c-4ed0-9877-3473fe63d929 already deleted. [ 735.876089] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-837be310-7b7c-4ed0-9877-3473fe63d929" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.052378] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-985 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.052568] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-985" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.052686] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-985" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.053307] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-985" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.058278] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.058278] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.058278] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.058278] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.058278] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.058278] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 736.058278] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 736.058278] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 736.058278] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 736.058278] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 736.058278] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 736.058278] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 736.085048] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 736.085048] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 736.085048] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 736.085048] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-985" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.085212] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-94553675-1168-47ee-8eaa-c44515c8782e taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.085404] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-94553675-1168-47ee-8eaa-c44515c8782e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.085522] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-94553675-1168-47ee-8eaa-c44515c8782e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.085867] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-94553675-1168-47ee-8eaa-c44515c8782e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.086000] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94553675-1168-47ee-8eaa-c44515c8782e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.114387] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a2d7e17-bca4-4474-a2c6-152a257dcccd in Status: SUCCESS [ 736.114715] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a2d7e17-bca4-4474-a2c6-152a257dcccd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.114886] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a2d7e17-bca4-4474-a2c6-152a257dcccd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.115113] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a2d7e17-bca4-4474-a2c6-152a257dcccd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.115307] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.115422] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.115487] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.115642] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.115724] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.115809] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a2d7e17-bca4-4474-a2c6-152a257dcccd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.115896] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7a2d7e17-bca4-4474-a2c6-152a257dcccd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.233055] env[70764]: INFO networking_nsxv3.common.synchronization [None req-42e5d3fa-91f6-4315-bb8c-664ebb0d1228 None None] Enqueued Resource ID: 09d14b52-03c9-4b37-b2fa-24f7c9da2ec9 with Priority: HIGHEST for action port [ 736.233194] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09d14b52-03c9-4b37-b2fa-24f7c9da2ec9 with Priority: HIGHEST for action port [ 736.233542] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-09d14b52-03c9-4b37-b2fa-24f7c9da2ec9 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.233700] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-09d14b52-03c9-4b37-b2fa-24f7c9da2ec9" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.233785] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-09d14b52-03c9-4b37-b2fa-24f7c9da2ec9" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.234710] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-09d14b52-03c9-4b37-b2fa-24f7c9da2ec9" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.234710] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09d14b52-03c9-4b37-b2fa-24f7c9da2ec9',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.278830] env[70764]: INFO networking_nsxv3.common.synchronization [None req-1da19f23-f9ac-4c15-b482-afebc2a08afc None None] Enqueued Resource ID: e74540a2-1b06-4a68-a7ed-d7d887af7d22 with Priority: HIGHEST for action port [ 736.279499] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e74540a2-1b06-4a68-a7ed-d7d887af7d22 with Priority: HIGHEST for action port [ 736.279872] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-e74540a2-1b06-4a68-a7ed-d7d887af7d22 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.280705] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e74540a2-1b06-4a68-a7ed-d7d887af7d22" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.280844] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e74540a2-1b06-4a68-a7ed-d7d887af7d22" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.281445] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e74540a2-1b06-4a68-a7ed-d7d887af7d22" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.282115] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e74540a2-1b06-4a68-a7ed-d7d887af7d22',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.309941] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.593773] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.593773] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.593773] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.594266] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.594266] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.594266] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 94553675-1168-47ee-8eaa-c44515c8782e not found, creating... [ 736.594430] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.595774] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.595774] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.595774] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.595774] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.595774] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.595774] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.595774] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.595774] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.596095] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.600430] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 94553675-1168-47ee-8eaa-c44515c8782e is going to be created. [ 736.620064] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.624749] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.624749] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.624749] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.624749] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.624749] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-94553675-1168-47ee-8eaa-c44515c8782e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.625179] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a2d7e17-bca4-4474-a2c6-152a257dcccd taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.625179] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a2d7e17-bca4-4474-a2c6-152a257dcccd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.625274] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a2d7e17-bca4-4474-a2c6-152a257dcccd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.625379] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a2d7e17-bca4-4474-a2c6-152a257dcccd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.625542] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.625644] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.625707] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.625852] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.625934] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.626032] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a2d7e17-bca4-4474-a2c6-152a257dcccd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.626180] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a2d7e17-bca4-4474-a2c6-152a257dcccd taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.626269] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a2d7e17-bca4-4474-a2c6-152a257dcccd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.626327] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a2d7e17-bca4-4474-a2c6-152a257dcccd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.626477] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a2d7e17-bca4-4474-a2c6-152a257dcccd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.626616] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.626720] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.626758] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.626895] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.626970] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.627058] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a2d7e17-bca4-4474-a2c6-152a257dcccd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.627145] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7a2d7e17-bca4-4474-a2c6-152a257dcccd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.736848] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 09d14b52-03c9-4b37-b2fa-24f7c9da2ec9 [ 736.737096] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.738272] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.738272] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.738272] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.738272] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.738272] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:09d14b52-03c9-4b37-b2fa-24f7c9da2ec9 already deleted. [ 736.738272] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-09d14b52-03c9-4b37-b2fa-24f7c9da2ec9" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.784180] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e74540a2-1b06-4a68-a7ed-d7d887af7d22 [ 736.784416] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.785573] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.785660] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.785871] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.785961] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.786075] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e74540a2-1b06-4a68-a7ed-d7d887af7d22 already deleted. [ 736.786783] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e74540a2-1b06-4a68-a7ed-d7d887af7d22" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.813608] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.130482] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7a2d7e17-bca4-4474-a2c6-152a257dcccd: rpc.has_security_group_logging(os_id): False [ 737.152907] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.153687] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.153687] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.153687] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.153687] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.153687] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.153687] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.153922] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.153922] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.154049] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.154260] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.155336] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.155393] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.155558] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.155667] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.155908] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.156149] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.156253] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.156421] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.156524] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.156675] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a2d7e17-bca4-4474-a2c6-152a257dcccd is going to be created. [ 737.218542] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.218701] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.218776] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.218986] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.219179] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.248465] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a2d7e17-bca4-4474-a2c6-152a257dcccd in Status: IN_PROGRESS for 2s [ 737.318495] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.318693] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.318762] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.318986] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.320010] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.320010] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8f5efec-a14e-4be6-8add-7b35a995c982 is going to be updated. [ 737.355495] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.355495] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.355495] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.355495] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.355699] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.366627] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: IN_PROGRESS for 2s [ 737.791599] env[70764]: INFO networking_nsxv3.common.synchronization [req-eec4916f-c619-42f6-8cd0-3071a5926d65 req-c7735785-d384-42c2-88a9-33b6d5017416 service nova] Enqueued Resource ID: 837be310-7b7c-4ed0-9877-3473fe63d929 with Priority: HIGHEST for action security_group_rules [ 737.791905] env[70764]: INFO networking_nsxv3.common.synchronization [req-eec4916f-c619-42f6-8cd0-3071a5926d65 req-c7735785-d384-42c2-88a9-33b6d5017416 service nova] Enqueued Resource ID: 837be310-7b7c-4ed0-9877-3473fe63d929 with Priority: HIGHEST for action security_group_members [ 737.791905] env[70764]: INFO networking_nsxv3.common.synchronization [req-eec4916f-c619-42f6-8cd0-3071a5926d65 req-c7735785-d384-42c2-88a9-33b6d5017416 service nova] Enqueued Resource ID: 94553675-1168-47ee-8eaa-c44515c8782e with Priority: HIGHEST for action port [ 737.792147] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 837be310-7b7c-4ed0-9877-3473fe63d929 with Priority: HIGHEST for action security_group_rules [ 737.792274] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 837be310-7b7c-4ed0-9877-3473fe63d929 with Priority: HIGHEST for action security_group_members [ 737.792368] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94553675-1168-47ee-8eaa-c44515c8782e with Priority: HIGHEST for action port [ 737.793364] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-837be310-7b7c-4ed0-9877-3473fe63d929 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.793432] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-837be310-7b7c-4ed0-9877-3473fe63d929" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.793493] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-837be310-7b7c-4ed0-9877-3473fe63d929" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.794513] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-837be310-7b7c-4ed0-9877-3473fe63d929" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.794616] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('837be310-7b7c-4ed0-9877-3473fe63d929',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.796084] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-837be310-7b7c-4ed0-9877-3473fe63d929 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.796214] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-837be310-7b7c-4ed0-9877-3473fe63d929" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.796283] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-837be310-7b7c-4ed0-9877-3473fe63d929" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.796464] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-837be310-7b7c-4ed0-9877-3473fe63d929" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.796614] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.796735] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.796796] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.796911] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.797015] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.797108] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('837be310-7b7c-4ed0-9877-3473fe63d929',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.797862] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-94553675-1168-47ee-8eaa-c44515c8782e taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.797973] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94553675-1168-47ee-8eaa-c44515c8782e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.798051] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94553675-1168-47ee-8eaa-c44515c8782e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.798206] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94553675-1168-47ee-8eaa-c44515c8782e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.798274] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94553675-1168-47ee-8eaa-c44515c8782e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.097430] env[70764]: INFO networking_nsxv3.common.synchronization [None req-db8eb09b-b3ea-4311-a3a7-509684955d5b None None] Enqueued Resource ID: 92803078-5917-48ee-aa7d-d03c07c8ec0c with Priority: HIGHEST for action port [ 738.097430] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92803078-5917-48ee-aa7d-d03c07c8ec0c with Priority: HIGHEST for action port [ 738.097430] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-92803078-5917-48ee-aa7d-d03c07c8ec0c taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.097430] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92803078-5917-48ee-aa7d-d03c07c8ec0c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.097430] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92803078-5917-48ee-aa7d-d03c07c8ec0c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.097430] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92803078-5917-48ee-aa7d-d03c07c8ec0c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.097430] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92803078-5917-48ee-aa7d-d03c07c8ec0c',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.218033] env[70764]: INFO networking_nsxv3.common.synchronization [None req-41caba34-e4bb-4be6-8ed0-5550a65fc605 tempest-ServersTestFqdnHostnames-964324386 tempest-ServersTestFqdnHostnames-964324386-project-member] Enqueued Resource ID: b221064c-6962-44ea-989e-cf4546ea92ab with Priority: HIGHEST for action security_group_rules [ 738.218033] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b221064c-6962-44ea-989e-cf4546ea92ab with Priority: HIGHEST for action security_group_rules [ 738.218033] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b221064c-6962-44ea-989e-cf4546ea92ab taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.218033] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b221064c-6962-44ea-989e-cf4546ea92ab" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.218790] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b221064c-6962-44ea-989e-cf4546ea92ab" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.219308] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b221064c-6962-44ea-989e-cf4546ea92ab" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.220667] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b221064c-6962-44ea-989e-cf4546ea92ab',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.301113] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('837be310-7b7c-4ed0-9877-3473fe63d929',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.302152] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-837be310-7b7c-4ed0-9877-3473fe63d929 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.302256] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-837be310-7b7c-4ed0-9877-3473fe63d929" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.302419] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 94553675-1168-47ee-8eaa-c44515c8782e with status ACTIVE [ 738.302576] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.302704] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.302741] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.302983] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.304529] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.304529] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.304529] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.304529] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.311236] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.311236] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.311236] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.311236] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.311236] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.311236] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.311236] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.311236] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 94553675-1168-47ee-8eaa-c44515c8782e is going to be updated. [ 738.311236] env[70764]: INFO networking_nsxv3.common.synchronization [None req-642ac44a-b71c-4ec8-9cdf-611a3f534483 tempest-ServersTestFqdnHostnames-964324386 tempest-ServersTestFqdnHostnames-964324386-project-member] Enqueued Resource ID: b221064c-6962-44ea-989e-cf4546ea92ab with Priority: HIGHEST for action security_group_rules [ 738.312221] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b221064c-6962-44ea-989e-cf4546ea92ab with Priority: HIGHEST for action security_group_rules [ 738.312934] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b221064c-6962-44ea-989e-cf4546ea92ab taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.313065] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b221064c-6962-44ea-989e-cf4546ea92ab" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.332252] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.333705] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.333705] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.333705] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.333705] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.333705] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94553675-1168-47ee-8eaa-c44515c8782e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.598886] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 92803078-5917-48ee-aa7d-d03c07c8ec0c [ 738.599032] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.599173] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.599254] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.599443] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.599609] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.599609] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:92803078-5917-48ee-aa7d-d03c07c8ec0c already deleted. [ 738.599713] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92803078-5917-48ee-aa7d-d03c07c8ec0c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.741435] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.742121] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.742306] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.742536] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.742631] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.742733] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b221064c-6962-44ea-989e-cf4546ea92ab already deleted. [ 738.742818] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b221064c-6962-44ea-989e-cf4546ea92ab" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.742973] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b221064c-6962-44ea-989e-cf4546ea92ab" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.743144] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b221064c-6962-44ea-989e-cf4546ea92ab" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.743234] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b221064c-6962-44ea-989e-cf4546ea92ab',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.812927] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('837be310-7b7c-4ed0-9877-3473fe63d929',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.260405] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a2d7e17-bca4-4474-a2c6-152a257dcccd in Status: SUCCESS [ 739.260998] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a2d7e17-bca4-4474-a2c6-152a257dcccd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.263583] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.263583] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.263583] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.263583] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.263583] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.263583] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b221064c-6962-44ea-989e-cf4546ea92ab already deleted. [ 739.263583] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b221064c-6962-44ea-989e-cf4546ea92ab" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.317014] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.317209] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.317209] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.318067] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.318067] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.318067] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 837be310-7b7c-4ed0-9877-3473fe63d929 is going to be created. [ 739.344565] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.345208] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.345208] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.345208] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.345420] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.353786] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 837be310-7b7c-4ed0-9877-3473fe63d929 in Status: UNINITIALIZED for 2s [ 739.385772] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: SUCCESS [ 739.385968] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.365114] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 837be310-7b7c-4ed0-9877-3473fe63d929 in Status: SUCCESS [ 741.365114] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-837be310-7b7c-4ed0-9877-3473fe63d929" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.365114] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-837be310-7b7c-4ed0-9877-3473fe63d929" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.365114] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-837be310-7b7c-4ed0-9877-3473fe63d929" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.365114] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.365114] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.365114] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.365114] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.365114] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.365114] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-837be310-7b7c-4ed0-9877-3473fe63d929" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.365114] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('837be310-7b7c-4ed0-9877-3473fe63d929',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.867654] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('837be310-7b7c-4ed0-9877-3473fe63d929',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.211119] env[70764]: INFO networking_nsxv3.common.synchronization [None req-93f491e7-1e11-404e-8f46-138a928b9c45 None None] Enqueued Resource ID: 86a08a0e-2436-426c-b409-25d7f5054d06 with Priority: HIGHEST for action port [ 742.211680] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86a08a0e-2436-426c-b409-25d7f5054d06 with Priority: HIGHEST for action port [ 742.211954] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-86a08a0e-2436-426c-b409-25d7f5054d06 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.212090] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86a08a0e-2436-426c-b409-25d7f5054d06" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.212157] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86a08a0e-2436-426c-b409-25d7f5054d06" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.212407] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86a08a0e-2436-426c-b409-25d7f5054d06" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.212520] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86a08a0e-2436-426c-b409-25d7f5054d06',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.357205] env[70764]: INFO networking_nsxv3.common.synchronization [req-814c8071-3f58-4ef0-87e4-daa707ad3fbc req-748df0cd-a521-4b4c-952a-ff99130e4857 tempest-InstanceActionsV221TestJSON-1997581410 tempest-InstanceActionsV221TestJSON-1997581410-project-member] Enqueued Resource ID: 7a2d7e17-bca4-4474-a2c6-152a257dcccd with Priority: HIGHEST for action security_group_members [ 742.357874] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a2d7e17-bca4-4474-a2c6-152a257dcccd with Priority: HIGHEST for action security_group_members [ 742.358189] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a2d7e17-bca4-4474-a2c6-152a257dcccd taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.358528] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a2d7e17-bca4-4474-a2c6-152a257dcccd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.358528] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a2d7e17-bca4-4474-a2c6-152a257dcccd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.358643] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a2d7e17-bca4-4474-a2c6-152a257dcccd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.358702] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.358889] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.358889] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.359010] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.359107] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.359173] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a2d7e17-bca4-4474-a2c6-152a257dcccd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.373102] env[70764]: INFO networking_nsxv3.common.synchronization [req-e4369d60-1008-42aa-964b-f1edc8f2a011 req-97ecc8ce-4322-4e45-9cfe-c596f056d2c6 tempest-SecurityGroupsTestJSON-512195178 tempest-SecurityGroupsTestJSON-512195178-project-member] Enqueued Resource ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b with Priority: HIGHEST for action security_group_members [ 742.373102] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 837be310-7b7c-4ed0-9877-3473fe63d929: rpc.has_security_group_logging(os_id): False [ 742.374086] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b with Priority: HIGHEST for action security_group_members [ 742.374086] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.374280] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.374353] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.374546] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.375041] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.375161] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.375232] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.375382] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.375484] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.375577] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.394991] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.395682] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.395682] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.395682] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.395682] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.395832] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.395894] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.395924] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.396062] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.396135] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.396219] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 837be310-7b7c-4ed0-9877-3473fe63d929 is going to be created. [ 742.459666] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.459811] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.459855] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.460083] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.460261] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.475293] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 837be310-7b7c-4ed0-9877-3473fe63d929 in Status: IN_PROGRESS for 2s [ 742.717845] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 86a08a0e-2436-426c-b409-25d7f5054d06 [ 742.717845] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.717845] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.717845] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.717845] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.717845] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.717845] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:86a08a0e-2436-426c-b409-25d7f5054d06 already deleted. [ 742.717845] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86a08a0e-2436-426c-b409-25d7f5054d06" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.849266] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-87 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.849752] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-87" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.850300] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-87" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.850662] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-87" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.851227] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.851558] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.851751] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.852067] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.852276] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.853030] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 742.853030] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 742.853030] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 742.853181] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 742.853284] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 742.853411] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 742.853558] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 742.861167] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.862227] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.862288] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.862485] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.862576] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.862787] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.862894] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.862957] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.863165] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.863246] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.863338] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a2d7e17-bca4-4474-a2c6-152a257dcccd is going to be updated. [ 742.876975] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 742.876975] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 742.876975] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 742.876975] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-87" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.877309] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-14d1a136-a110-4aca-baed-5e7c68a0ccb5 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.877479] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-14d1a136-a110-4aca-baed-5e7c68a0ccb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.877593] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-14d1a136-a110-4aca-baed-5e7c68a0ccb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.877955] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-14d1a136-a110-4aca-baed-5e7c68a0ccb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.878300] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14d1a136-a110-4aca-baed-5e7c68a0ccb5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.881655] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.892227] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.892374] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.892440] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.892642] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.892793] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.908650] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a2d7e17-bca4-4474-a2c6-152a257dcccd in Status: IN_PROGRESS for 2s [ 743.187640] env[70764]: INFO networking_nsxv3.common.synchronization [None req-802aa763-07cb-47db-a901-e992bd106f60 tempest-ServersTestManualDisk-1468672688 tempest-ServersTestManualDisk-1468672688-project-member] Enqueued Resource ID: 4402a532-4a5c-4a18-993a-a6249c552031 with Priority: HIGHEST for action security_group_rules [ 743.187640] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4402a532-4a5c-4a18-993a-a6249c552031 with Priority: HIGHEST for action security_group_rules [ 743.187640] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4402a532-4a5c-4a18-993a-a6249c552031 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.187640] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4402a532-4a5c-4a18-993a-a6249c552031" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.187640] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4402a532-4a5c-4a18-993a-a6249c552031" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.187640] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4402a532-4a5c-4a18-993a-a6249c552031" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.187640] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4402a532-4a5c-4a18-993a-a6249c552031',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.276798] env[70764]: INFO networking_nsxv3.common.synchronization [None req-9b565e2d-f1c0-44bf-ba7f-849b3bf62b2a tempest-ServersTestManualDisk-1468672688 tempest-ServersTestManualDisk-1468672688-project-member] Enqueued Resource ID: 4402a532-4a5c-4a18-993a-a6249c552031 with Priority: HIGHEST for action security_group_rules [ 743.276798] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4402a532-4a5c-4a18-993a-a6249c552031 with Priority: HIGHEST for action security_group_rules [ 743.276798] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4402a532-4a5c-4a18-993a-a6249c552031 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.276798] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4402a532-4a5c-4a18-993a-a6249c552031" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.388020] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.388020] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.388020] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.388020] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.388020] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.388020] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 14d1a136-a110-4aca-baed-5e7c68a0ccb5 not found, creating... [ 743.388020] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.388020] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.388020] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.388020] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.388020] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.388914] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.388914] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.388914] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.388914] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.388914] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.388914] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 14d1a136-a110-4aca-baed-5e7c68a0ccb5 is going to be created. [ 743.388914] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.407986] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.408214] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.408332] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.408619] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.408898] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.409114] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-14d1a136-a110-4aca-baed-5e7c68a0ccb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.709028] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.709180] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.709234] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.709451] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.709535] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.709648] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4402a532-4a5c-4a18-993a-a6249c552031 already deleted. [ 743.709740] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4402a532-4a5c-4a18-993a-a6249c552031" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.712199] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4402a532-4a5c-4a18-993a-a6249c552031" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.713251] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4402a532-4a5c-4a18-993a-a6249c552031" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.713251] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4402a532-4a5c-4a18-993a-a6249c552031',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.891060] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.891234] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.891292] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.891575] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.891679] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.891829] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b is going to be updated. [ 743.921193] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.921373] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.921589] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.921654] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.921795] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.931914] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b in Status: IN_PROGRESS for 2s [ 744.235565] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.235801] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.236116] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.236392] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.236601] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.236872] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4402a532-4a5c-4a18-993a-a6249c552031 already deleted. [ 744.236942] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4402a532-4a5c-4a18-993a-a6249c552031" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.278483] env[70764]: INFO networking_nsxv3.common.synchronization [req-e4369d60-1008-42aa-964b-f1edc8f2a011 req-6a303c3c-76fb-494f-8b9f-6758747a0acc service nova] Enqueued Resource ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b with Priority: HIGHEST for action security_group_rules [ 744.278654] env[70764]: INFO networking_nsxv3.common.synchronization [req-e4369d60-1008-42aa-964b-f1edc8f2a011 req-6a303c3c-76fb-494f-8b9f-6758747a0acc service nova] Enqueued Resource ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b with Priority: HIGHEST for action security_group_members [ 744.278821] env[70764]: INFO networking_nsxv3.common.synchronization [req-e4369d60-1008-42aa-964b-f1edc8f2a011 req-6a303c3c-76fb-494f-8b9f-6758747a0acc service nova] Enqueued Resource ID: 14d1a136-a110-4aca-baed-5e7c68a0ccb5 with Priority: HIGHEST for action port [ 744.279229] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b with Priority: HIGHEST for action security_group_rules [ 744.279566] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b with Priority: HIGHEST for action security_group_members [ 744.280104] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14d1a136-a110-4aca-baed-5e7c68a0ccb5 with Priority: HIGHEST for action port [ 744.281036] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c2d79e00-b6b0-41f3-96fb-49ab2b10751b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.281036] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.281191] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.281322] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.281453] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.282269] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.282371] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.282950] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-14d1a136-a110-4aca-baed-5e7c68a0ccb5 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.282950] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14d1a136-a110-4aca-baed-5e7c68a0ccb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.282950] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14d1a136-a110-4aca-baed-5e7c68a0ccb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.283421] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14d1a136-a110-4aca-baed-5e7c68a0ccb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.283421] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14d1a136-a110-4aca-baed-5e7c68a0ccb5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.497900] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 837be310-7b7c-4ed0-9877-3473fe63d929 in Status: SUCCESS [ 744.498282] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-837be310-7b7c-4ed0-9877-3473fe63d929" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.584138] env[70764]: INFO networking_nsxv3.common.synchronization [None req-8aa19742-4190-489d-a1c3-e4d228c423fa None None] Enqueued Resource ID: cfcfdd58-f3b0-460b-b98a-dcdf2b7382cd with Priority: HIGHEST for action port [ 744.584620] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfcfdd58-f3b0-460b-b98a-dcdf2b7382cd with Priority: HIGHEST for action port [ 744.584948] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-cfcfdd58-f3b0-460b-b98a-dcdf2b7382cd taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.585701] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cfcfdd58-f3b0-460b-b98a-dcdf2b7382cd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.585796] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cfcfdd58-f3b0-460b-b98a-dcdf2b7382cd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.587192] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cfcfdd58-f3b0-460b-b98a-dcdf2b7382cd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.587341] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cfcfdd58-f3b0-460b-b98a-dcdf2b7382cd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.785413] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.785413] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.785413] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 14d1a136-a110-4aca-baed-5e7c68a0ccb5 with status ACTIVE [ 744.785683] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.785683] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.785837] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.785914] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.788204] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.788204] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.788204] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.788204] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.788204] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.788204] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.788204] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.788204] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.788204] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.788204] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.788204] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.788204] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 14d1a136-a110-4aca-baed-5e7c68a0ccb5 is going to be updated. [ 744.807495] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.807495] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.807495] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.807495] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.807755] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.807877] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14d1a136-a110-4aca-baed-5e7c68a0ccb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.919704] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a2d7e17-bca4-4474-a2c6-152a257dcccd in Status: SUCCESS [ 744.919891] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a2d7e17-bca4-4474-a2c6-152a257dcccd deletion is rescheduled due to dependency. [ 744.920011] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a2d7e17-bca4-4474-a2c6-152a257dcccd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.027301] env[70764]: INFO networking_nsxv3.common.synchronization [req-f100912d-98b4-4b6e-a39a-2502f31027d4 req-d225fd85-8413-407f-aaff-d1bc3746a097 tempest-ServersAdminNegativeTestJSON-803035860 tempest-ServersAdminNegativeTestJSON-803035860-project-member] Enqueued Resource ID: a793445b-22a7-4c79-b31c-1beebe657659 with Priority: HIGHEST for action security_group_members [ 745.027971] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a793445b-22a7-4c79-b31c-1beebe657659 with Priority: HIGHEST for action security_group_members [ 745.028618] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-a793445b-22a7-4c79-b31c-1beebe657659 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.028995] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.028995] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.029143] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.029332] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.029488] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.029584] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.029799] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.029913] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.030060] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a793445b-22a7-4c79-b31c-1beebe657659',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.089976] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cfcfdd58-f3b0-460b-b98a-dcdf2b7382cd [ 745.090287] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.090401] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.090476] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.090698] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.090815] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.090930] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cfcfdd58-f3b0-460b-b98a-dcdf2b7382cd already deleted. [ 745.091042] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cfcfdd58-f3b0-460b-b98a-dcdf2b7382cd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.375488] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-343 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.375713] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-343" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.375797] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-343" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.376074] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-343" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.376331] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.376505] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.376645] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.376945] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.377041] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.377258] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 745.377385] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 745.377495] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 745.377602] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 745.377707] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 745.378920] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 745.379127] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 745.397654] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 745.397833] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 745.397974] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 745.398143] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-343" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.398488] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-671b06d8-ce24-42c3-a496-084db764785d taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.398632] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-671b06d8-ce24-42c3-a496-084db764785d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.398812] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-671b06d8-ce24-42c3-a496-084db764785d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.399165] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-671b06d8-ce24-42c3-a496-084db764785d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.399913] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('671b06d8-ce24-42c3-a496-084db764785d',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.533368] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a793445b-22a7-4c79-b31c-1beebe657659',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.902156] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.902424] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.902580] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.902884] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.903061] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.903221] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 671b06d8-ce24-42c3-a496-084db764785d not found, creating... [ 745.903484] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.903640] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.903754] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.903975] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.904125] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.904440] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.904599] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.904737] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.904954] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.905102] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.905239] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 671b06d8-ce24-42c3-a496-084db764785d is going to be created. [ 745.927383] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.927560] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.927634] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.928012] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.928357] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.928674] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-671b06d8-ce24-42c3-a496-084db764785d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.940495] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b in Status: SUCCESS [ 745.940804] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.940880] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.941554] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.941554] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.941554] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.941554] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.941834] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.941834] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.941834] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.034892] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a793445b-22a7-4c79-b31c-1beebe657659',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.445037] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.543321] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.543705] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.543705] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.544550] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.544550] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.544550] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a793445b-22a7-4c79-b31c-1beebe657659 is going to be updated. [ 746.570226] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.570381] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.570456] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.570821] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.570926] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.579652] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a793445b-22a7-4c79-b31c-1beebe657659 in Status: IN_PROGRESS for 2s [ 746.942744] env[70764]: INFO networking_nsxv3.common.synchronization [req-f100912d-98b4-4b6e-a39a-2502f31027d4 req-47ea80c2-638c-4adf-a29e-a20721a01e13 service nova] Enqueued Resource ID: a793445b-22a7-4c79-b31c-1beebe657659 with Priority: HIGHEST for action security_group_rules [ 746.942948] env[70764]: INFO networking_nsxv3.common.synchronization [req-f100912d-98b4-4b6e-a39a-2502f31027d4 req-47ea80c2-638c-4adf-a29e-a20721a01e13 service nova] Enqueued Resource ID: a793445b-22a7-4c79-b31c-1beebe657659 with Priority: HIGHEST for action security_group_members [ 746.943102] env[70764]: INFO networking_nsxv3.common.synchronization [req-f100912d-98b4-4b6e-a39a-2502f31027d4 req-47ea80c2-638c-4adf-a29e-a20721a01e13 service nova] Enqueued Resource ID: 671b06d8-ce24-42c3-a496-084db764785d with Priority: HIGHEST for action port [ 746.943329] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a793445b-22a7-4c79-b31c-1beebe657659 with Priority: HIGHEST for action security_group_rules [ 746.943451] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a793445b-22a7-4c79-b31c-1beebe657659 with Priority: HIGHEST for action security_group_members [ 746.943541] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 671b06d8-ce24-42c3-a496-084db764785d with Priority: HIGHEST for action port [ 746.945096] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a793445b-22a7-4c79-b31c-1beebe657659 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.945369] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.945469] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.945721] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.945840] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a793445b-22a7-4c79-b31c-1beebe657659',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.946719] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-a793445b-22a7-4c79-b31c-1beebe657659 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.946846] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.947098] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-671b06d8-ce24-42c3-a496-084db764785d taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.947236] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-671b06d8-ce24-42c3-a496-084db764785d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.947615] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-671b06d8-ce24-42c3-a496-084db764785d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.947835] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-671b06d8-ce24-42c3-a496-084db764785d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.947946] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('671b06d8-ce24-42c3-a496-084db764785d',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.949181] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.449507] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-a793445b-22a7-4c79-b31c-1beebe657659 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.449662] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.451032] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 671b06d8-ce24-42c3-a496-084db764785d with status ACTIVE [ 747.451281] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.451383] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.451383] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.451590] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.451676] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.452162] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.452307] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.452381] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.452573] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.452651] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.452851] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.452947] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.453024] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.453184] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.453267] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.453417] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 671b06d8-ce24-42c3-a496-084db764785d is going to be updated. [ 747.454464] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.454591] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.454722] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.454962] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.455077] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.455168] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b is going to be updated. [ 747.475555] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.475735] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.475817] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.476020] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.476172] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.476330] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-671b06d8-ce24-42c3-a496-084db764785d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.480194] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.480194] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.480450] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.480450] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.480588] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.489450] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b in Status: IN_PROGRESS for 2s [ 747.661529] env[70764]: INFO networking_nsxv3.common.synchronization [req-2d5485fd-b934-42a5-8b97-fea2824c2b89 req-12330109-5ca3-4341-9d31-3a08bca465ec tempest-ImagesOneServerTestJSON-393500790 tempest-ImagesOneServerTestJSON-393500790-project-member] Enqueued Resource ID: bb6f4eb6-36d0-4604-a204-4c47b22b4b54 with Priority: HIGHEST for action security_group_members [ 747.662134] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb6f4eb6-36d0-4604-a204-4c47b22b4b54 with Priority: HIGHEST for action security_group_members [ 747.662550] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb6f4eb6-36d0-4604-a204-4c47b22b4b54 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.663027] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb6f4eb6-36d0-4604-a204-4c47b22b4b54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.663027] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb6f4eb6-36d0-4604-a204-4c47b22b4b54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.663623] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb6f4eb6-36d0-4604-a204-4c47b22b4b54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.664067] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.665599] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.665599] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.665599] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.665599] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.665599] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb6f4eb6-36d0-4604-a204-4c47b22b4b54',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.168444] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.168444] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.168444] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.168444] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.168444] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.168444] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.168444] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.168444] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.168444] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.168444] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.168444] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb6f4eb6-36d0-4604-a204-4c47b22b4b54 already deleted. [ 748.168444] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb6f4eb6-36d0-4604-a204-4c47b22b4b54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.201029] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-101 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.201226] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-101" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.201364] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-101" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.202055] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-101" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.202347] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.202533] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.202620] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.202839] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.204861] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.205283] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 748.205283] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 748.205395] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 748.205428] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 748.205989] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 748.205989] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 748.205989] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 748.231072] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 748.231072] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 748.231072] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 748.231072] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-101" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.231072] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-be95c27b-1861-48a9-a7a0-de721e105e4f taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.231072] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-be95c27b-1861-48a9-a7a0-de721e105e4f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.231072] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-be95c27b-1861-48a9-a7a0-de721e105e4f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.231072] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-be95c27b-1861-48a9-a7a0-de721e105e4f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.231072] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be95c27b-1861-48a9-a7a0-de721e105e4f',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.589432] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a793445b-22a7-4c79-b31c-1beebe657659 in Status: SUCCESS [ 748.591544] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.591544] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.591544] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.591544] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.591544] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.591544] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.591544] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.591544] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.591544] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a793445b-22a7-4c79-b31c-1beebe657659',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.649453] env[70764]: INFO networking_nsxv3.common.synchronization [None req-a4f9df9d-ae62-4c11-9566-bc2cb8d05197 None None] Enqueued Resource ID: 5ee8a81d-d31d-4001-8b51-da1307ac3264 with Priority: HIGHEST for action port [ 748.649453] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ee8a81d-d31d-4001-8b51-da1307ac3264 with Priority: HIGHEST for action port [ 748.649453] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ee8a81d-d31d-4001-8b51-da1307ac3264 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.649453] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ee8a81d-d31d-4001-8b51-da1307ac3264" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.649453] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ee8a81d-d31d-4001-8b51-da1307ac3264" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.649453] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ee8a81d-d31d-4001-8b51-da1307ac3264" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.649453] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ee8a81d-d31d-4001-8b51-da1307ac3264',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.733835] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.735098] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.735098] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.735098] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.735098] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.735098] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port be95c27b-1861-48a9-a7a0-de721e105e4f not found, creating... [ 748.735098] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.735327] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.735327] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.735463] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.735605] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.735914] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.736284] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.736432] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.736663] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.736880] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.737473] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: be95c27b-1861-48a9-a7a0-de721e105e4f is going to be created. [ 748.757456] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.757706] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.757835] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.758159] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.758407] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.758657] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-be95c27b-1861-48a9-a7a0-de721e105e4f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.097037] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a793445b-22a7-4c79-b31c-1beebe657659',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.150364] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5ee8a81d-d31d-4001-8b51-da1307ac3264 [ 749.151071] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.151071] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.151071] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.151362] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.151499] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.151656] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5ee8a81d-d31d-4001-8b51-da1307ac3264 already deleted. [ 749.151761] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ee8a81d-d31d-4001-8b51-da1307ac3264" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.498653] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b in Status: SUCCESS [ 749.498744] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.501981] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.501981] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.501981] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.501981] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.501981] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.501981] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.501981] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.501981] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.501981] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.600518] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a793445b-22a7-4c79-b31c-1beebe657659',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.776280] env[70764]: INFO networking_nsxv3.common.synchronization [req-2d5485fd-b934-42a5-8b97-fea2824c2b89 req-88ef7d68-f23d-4ab2-989f-a9afd5355ef6 service nova] Enqueued Resource ID: bb6f4eb6-36d0-4604-a204-4c47b22b4b54 with Priority: HIGHEST for action security_group_rules [ 749.776553] env[70764]: INFO networking_nsxv3.common.synchronization [req-2d5485fd-b934-42a5-8b97-fea2824c2b89 req-88ef7d68-f23d-4ab2-989f-a9afd5355ef6 service nova] Enqueued Resource ID: bb6f4eb6-36d0-4604-a204-4c47b22b4b54 with Priority: HIGHEST for action security_group_members [ 749.776592] env[70764]: INFO networking_nsxv3.common.synchronization [req-2d5485fd-b934-42a5-8b97-fea2824c2b89 req-88ef7d68-f23d-4ab2-989f-a9afd5355ef6 service nova] Enqueued Resource ID: be95c27b-1861-48a9-a7a0-de721e105e4f with Priority: HIGHEST for action port [ 749.777222] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb6f4eb6-36d0-4604-a204-4c47b22b4b54 with Priority: HIGHEST for action security_group_rules [ 749.777321] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb6f4eb6-36d0-4604-a204-4c47b22b4b54 with Priority: HIGHEST for action security_group_members [ 749.777368] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be95c27b-1861-48a9-a7a0-de721e105e4f with Priority: HIGHEST for action port [ 749.777797] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb6f4eb6-36d0-4604-a204-4c47b22b4b54 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.777873] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb6f4eb6-36d0-4604-a204-4c47b22b4b54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.777962] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb6f4eb6-36d0-4604-a204-4c47b22b4b54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.778201] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb6f4eb6-36d0-4604-a204-4c47b22b4b54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.778290] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb6f4eb6-36d0-4604-a204-4c47b22b4b54',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.779375] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb6f4eb6-36d0-4604-a204-4c47b22b4b54 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.779375] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb6f4eb6-36d0-4604-a204-4c47b22b4b54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.779375] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb6f4eb6-36d0-4604-a204-4c47b22b4b54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.779576] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb6f4eb6-36d0-4604-a204-4c47b22b4b54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.779619] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.779711] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.779746] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.781099] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.781099] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.781099] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb6f4eb6-36d0-4604-a204-4c47b22b4b54',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.781099] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-be95c27b-1861-48a9-a7a0-de721e105e4f taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.781099] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be95c27b-1861-48a9-a7a0-de721e105e4f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.781099] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be95c27b-1861-48a9-a7a0-de721e105e4f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.781609] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be95c27b-1861-48a9-a7a0-de721e105e4f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.781609] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be95c27b-1861-48a9-a7a0-de721e105e4f',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.002145] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.002360] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.002424] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.002632] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.002802] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.002933] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.002983] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.003149] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.003240] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.003329] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.003479] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.003591] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.003681] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.003928] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.004048] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.004185] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.004257] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.004408] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.004503] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.004564] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.004652] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.103394] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.103394] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.103543] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.103816] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.105904] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.105904] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a793445b-22a7-4c79-b31c-1beebe657659 is going to be updated. [ 750.124887] env[70764]: INFO networking_nsxv3.common.synchronization [None req-d66315c4-7f53-47a5-a450-7cbcf544b3f3 tempest-ServersTestBootFromVolume-2146126926 tempest-ServersTestBootFromVolume-2146126926-project-member] Enqueued Resource ID: dffe2468-a89e-4c09-9b45-a73f1d41f82e with Priority: HIGHEST for action security_group_rules [ 750.125868] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dffe2468-a89e-4c09-9b45-a73f1d41f82e with Priority: HIGHEST for action security_group_rules [ 750.125868] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dffe2468-a89e-4c09-9b45-a73f1d41f82e taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.126076] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dffe2468-a89e-4c09-9b45-a73f1d41f82e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.126263] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dffe2468-a89e-4c09-9b45-a73f1d41f82e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.126658] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dffe2468-a89e-4c09-9b45-a73f1d41f82e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.126799] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dffe2468-a89e-4c09-9b45-a73f1d41f82e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.133389] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.133648] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.133831] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.134305] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.134551] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.151890] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a793445b-22a7-4c79-b31c-1beebe657659 in Status: IN_PROGRESS for 2s [ 750.269329] env[70764]: INFO networking_nsxv3.common.synchronization [None req-817d8a36-5c27-4b99-b2e1-0f74da3046c3 tempest-ServersTestBootFromVolume-2146126926 tempest-ServersTestBootFromVolume-2146126926-project-member] Enqueued Resource ID: dffe2468-a89e-4c09-9b45-a73f1d41f82e with Priority: HIGHEST for action security_group_rules [ 750.269873] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dffe2468-a89e-4c09-9b45-a73f1d41f82e with Priority: HIGHEST for action security_group_rules [ 750.270309] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dffe2468-a89e-4c09-9b45-a73f1d41f82e taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.270503] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dffe2468-a89e-4c09-9b45-a73f1d41f82e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.284149] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bb6f4eb6-36d0-4604-a204-4c47b22b4b54',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.284998] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb6f4eb6-36d0-4604-a204-4c47b22b4b54 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.285184] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb6f4eb6-36d0-4604-a204-4c47b22b4b54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.285352] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port be95c27b-1861-48a9-a7a0-de721e105e4f with status ACTIVE [ 750.285490] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.285701] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.285701] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.285959] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.285959] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.286235] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.286328] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.286378] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.286560] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.286643] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.286855] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.286922] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.286972] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.287307] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.287422] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.287592] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: be95c27b-1861-48a9-a7a0-de721e105e4f is going to be updated. [ 750.312803] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.312974] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.313048] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.313616] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.313616] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.313753] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be95c27b-1861-48a9-a7a0-de721e105e4f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.483301] env[70764]: INFO networking_nsxv3.common.synchronization [None req-dac98139-79a2-455e-aabe-ced20f293c48 None None] Enqueued Resource ID: 2b082e09-d2ea-4f10-8c53-18f21268f18a with Priority: HIGHEST for action port [ 750.484516] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b082e09-d2ea-4f10-8c53-18f21268f18a with Priority: HIGHEST for action port [ 750.485243] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b082e09-d2ea-4f10-8c53-18f21268f18a taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.488142] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b082e09-d2ea-4f10-8c53-18f21268f18a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.488142] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b082e09-d2ea-4f10-8c53-18f21268f18a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.488142] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b082e09-d2ea-4f10-8c53-18f21268f18a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.488142] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b082e09-d2ea-4f10-8c53-18f21268f18a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.507367] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c2d79e00-b6b0-41f3-96fb-49ab2b10751b: rpc.has_security_group_logging(os_id): False [ 750.526705] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.526888] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.526927] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.527186] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.527305] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.527498] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.527598] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.527650] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.527798] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.527874] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.528064] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.528185] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.528243] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.528383] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.528455] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.528684] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.528740] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.528779] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.528899] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.528972] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.529071] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b is going to be updated. [ 750.587886] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.588072] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.588112] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.588321] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.588462] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.601799] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b in Status: IN_PROGRESS for 2s [ 750.651036] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.651036] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.651036] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.651036] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.651036] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.651036] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dffe2468-a89e-4c09-9b45-a73f1d41f82e already deleted. [ 750.651036] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dffe2468-a89e-4c09-9b45-a73f1d41f82e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.651036] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dffe2468-a89e-4c09-9b45-a73f1d41f82e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.651036] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dffe2468-a89e-4c09-9b45-a73f1d41f82e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.651036] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dffe2468-a89e-4c09-9b45-a73f1d41f82e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.790955] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bb6f4eb6-36d0-4604-a204-4c47b22b4b54',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.988848] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2b082e09-d2ea-4f10-8c53-18f21268f18a [ 750.989109] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.989338] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.989381] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.989605] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.989650] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.989733] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2b082e09-d2ea-4f10-8c53-18f21268f18a already deleted. [ 750.989841] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b082e09-d2ea-4f10-8c53-18f21268f18a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.175993] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.176197] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.176637] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.176637] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.176637] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.176637] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dffe2468-a89e-4c09-9b45-a73f1d41f82e already deleted. [ 751.176798] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dffe2468-a89e-4c09-9b45-a73f1d41f82e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.295738] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.295738] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.295738] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.295738] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.295738] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.295738] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb6f4eb6-36d0-4604-a204-4c47b22b4b54 is going to be created. [ 751.316510] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.316664] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.316732] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.317045] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.317414] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.328709] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb6f4eb6-36d0-4604-a204-4c47b22b4b54 in Status: UNINITIALIZED for 2s [ 752.164730] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a793445b-22a7-4c79-b31c-1beebe657659 in Status: SUCCESS [ 752.165046] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.165178] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.165487] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.165707] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.166100] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.166100] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.166100] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.166216] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.166391] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.166391] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a793445b-22a7-4c79-b31c-1beebe657659',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.617473] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b in Status: SUCCESS [ 752.617789] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.671153] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-a793445b-22a7-4c79-b31c-1beebe657659 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.671310] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.671382] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.671608] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.671808] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.671933] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.671997] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.672169] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.672269] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.672357] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.672506] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-a793445b-22a7-4c79-b31c-1beebe657659 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.672614] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.672662] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.672817] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.672977] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.673111] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.673251] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.673310] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.673355] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.673485] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.673578] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a793445b-22a7-4c79-b31c-1beebe657659',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.177163] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a793445b-22a7-4c79-b31c-1beebe657659: rpc.has_security_group_logging(os_id): False [ 753.202167] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.202343] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.202381] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.202625] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.202714] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.202883] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.203010] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.203067] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.203235] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.203324] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.203628] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.203750] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.203816] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.203973] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.204103] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.204291] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.204386] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.204447] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.204583] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.204655] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.204741] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a793445b-22a7-4c79-b31c-1beebe657659 is going to be updated. [ 753.281293] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.281531] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.281681] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.281822] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.281983] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.298470] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a793445b-22a7-4c79-b31c-1beebe657659 in Status: IN_PROGRESS for 2s [ 753.338019] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb6f4eb6-36d0-4604-a204-4c47b22b4b54 in Status: SUCCESS [ 753.338233] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb6f4eb6-36d0-4604-a204-4c47b22b4b54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.338827] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb6f4eb6-36d0-4604-a204-4c47b22b4b54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.338827] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb6f4eb6-36d0-4604-a204-4c47b22b4b54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.338827] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.339071] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.339071] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.339512] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.339512] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.339512] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb6f4eb6-36d0-4604-a204-4c47b22b4b54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.339512] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bb6f4eb6-36d0-4604-a204-4c47b22b4b54',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.841862] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb6f4eb6-36d0-4604-a204-4c47b22b4b54 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.842051] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb6f4eb6-36d0-4604-a204-4c47b22b4b54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.842051] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb6f4eb6-36d0-4604-a204-4c47b22b4b54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.842284] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb6f4eb6-36d0-4604-a204-4c47b22b4b54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.842461] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.842575] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.842653] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.842776] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.842864] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.842940] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb6f4eb6-36d0-4604-a204-4c47b22b4b54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.843111] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb6f4eb6-36d0-4604-a204-4c47b22b4b54 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.843216] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb6f4eb6-36d0-4604-a204-4c47b22b4b54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.843261] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb6f4eb6-36d0-4604-a204-4c47b22b4b54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.843384] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb6f4eb6-36d0-4604-a204-4c47b22b4b54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.843520] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.843610] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.843670] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.843798] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.843884] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.843976] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb6f4eb6-36d0-4604-a204-4c47b22b4b54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.844077] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bb6f4eb6-36d0-4604-a204-4c47b22b4b54',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.226122] env[70764]: INFO networking_nsxv3.common.synchronization [req-96c5ff0a-7581-42a5-8c4c-588c3840eeed req-b83ce953-d273-458e-93d7-2e31edf667b0 tempest-SecurityGroupsTestJSON-512195178 tempest-SecurityGroupsTestJSON-512195178-project-member] Enqueued Resource ID: fc0ae2a8-a235-4d05-9f57-5fec83d37151 with Priority: HIGHEST for action security_group_members [ 754.226122] env[70764]: INFO networking_nsxv3.common.synchronization [req-96c5ff0a-7581-42a5-8c4c-588c3840eeed req-b83ce953-d273-458e-93d7-2e31edf667b0 tempest-SecurityGroupsTestJSON-512195178 tempest-SecurityGroupsTestJSON-512195178-project-member] Enqueued Resource ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b with Priority: HIGHEST for action security_group_members [ 754.226381] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc0ae2a8-a235-4d05-9f57-5fec83d37151 with Priority: HIGHEST for action security_group_members [ 754.226381] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b with Priority: HIGHEST for action security_group_members [ 754.226707] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc0ae2a8-a235-4d05-9f57-5fec83d37151 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.228332] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc0ae2a8-a235-4d05-9f57-5fec83d37151" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.228332] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc0ae2a8-a235-4d05-9f57-5fec83d37151" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.228332] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc0ae2a8-a235-4d05-9f57-5fec83d37151" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.228332] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.228332] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.228332] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.228332] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.228332] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.228332] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc0ae2a8-a235-4d05-9f57-5fec83d37151',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.228712] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.228771] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.228808] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.228956] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.229106] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.229215] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.229268] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.229384] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.229538] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.229538] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.354039] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bb6f4eb6-36d0-4604-a204-4c47b22b4b54: rpc.has_security_group_logging(os_id): False [ 754.371761] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.371840] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.371937] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.372428] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.372547] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.372794] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.372921] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.372985] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.373164] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.373240] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.373415] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.373508] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.373567] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.373701] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.373775] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.373956] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.374138] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.374206] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.374376] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.374508] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.374539] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb6f4eb6-36d0-4604-a204-4c47b22b4b54 is going to be created. [ 754.378297] env[70764]: INFO networking_nsxv3.common.synchronization [req-96c5ff0a-7581-42a5-8c4c-588c3840eeed req-b83ce953-d273-458e-93d7-2e31edf667b0 tempest-SecurityGroupsTestJSON-512195178 tempest-SecurityGroupsTestJSON-512195178-project-member] Enqueued Resource ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b with Priority: HIGHEST for action security_group_rules [ 754.378472] env[70764]: INFO networking_nsxv3.common.synchronization [req-96c5ff0a-7581-42a5-8c4c-588c3840eeed req-b83ce953-d273-458e-93d7-2e31edf667b0 tempest-SecurityGroupsTestJSON-512195178 tempest-SecurityGroupsTestJSON-512195178-project-member] Enqueued Resource ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b with Priority: HIGHEST for action security_group_members [ 754.378990] env[70764]: INFO networking_nsxv3.common.synchronization [req-96c5ff0a-7581-42a5-8c4c-588c3840eeed req-b83ce953-d273-458e-93d7-2e31edf667b0 tempest-SecurityGroupsTestJSON-512195178 tempest-SecurityGroupsTestJSON-512195178-project-member] Enqueued Resource ID: fc0ae2a8-a235-4d05-9f57-5fec83d37151 with Priority: HIGHEST for action security_group_rules [ 754.378990] env[70764]: INFO networking_nsxv3.common.synchronization [req-96c5ff0a-7581-42a5-8c4c-588c3840eeed req-b83ce953-d273-458e-93d7-2e31edf667b0 tempest-SecurityGroupsTestJSON-512195178 tempest-SecurityGroupsTestJSON-512195178-project-member] Enqueued Resource ID: fc0ae2a8-a235-4d05-9f57-5fec83d37151 with Priority: HIGHEST for action security_group_members [ 754.378990] env[70764]: INFO networking_nsxv3.common.synchronization [req-96c5ff0a-7581-42a5-8c4c-588c3840eeed req-b83ce953-d273-458e-93d7-2e31edf667b0 tempest-SecurityGroupsTestJSON-512195178 tempest-SecurityGroupsTestJSON-512195178-project-member] Enqueued Resource ID: 14d1a136-a110-4aca-baed-5e7c68a0ccb5 with Priority: HIGHEST for action port [ 754.379197] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b with Priority: HIGHEST for action security_group_rules [ 754.379294] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc0ae2a8-a235-4d05-9f57-5fec83d37151 with Priority: HIGHEST for action security_group_rules [ 754.379390] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14d1a136-a110-4aca-baed-5e7c68a0ccb5 with Priority: HIGHEST for action port [ 754.379481] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b with Priority: HIGHEST for action security_group_members [ 754.379567] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc0ae2a8-a235-4d05-9f57-5fec83d37151 with Priority: HIGHEST for action security_group_members [ 754.380172] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c2d79e00-b6b0-41f3-96fb-49ab2b10751b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.380230] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.380699] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.380699] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.380699] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.381348] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc0ae2a8-a235-4d05-9f57-5fec83d37151 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.384307] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc0ae2a8-a235-4d05-9f57-5fec83d37151" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.384307] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc0ae2a8-a235-4d05-9f57-5fec83d37151" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.384307] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc0ae2a8-a235-4d05-9f57-5fec83d37151" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.384307] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc0ae2a8-a235-4d05-9f57-5fec83d37151',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.384307] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-14d1a136-a110-4aca-baed-5e7c68a0ccb5 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.384307] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14d1a136-a110-4aca-baed-5e7c68a0ccb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.384307] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14d1a136-a110-4aca-baed-5e7c68a0ccb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.384307] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14d1a136-a110-4aca-baed-5e7c68a0ccb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.384307] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14d1a136-a110-4aca-baed-5e7c68a0ccb5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.384867] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.385388] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.385388] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc0ae2a8-a235-4d05-9f57-5fec83d37151 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.385388] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc0ae2a8-a235-4d05-9f57-5fec83d37151" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.475042] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.475177] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.475177] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.475399] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.475612] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.488608] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb6f4eb6-36d0-4604-a204-4c47b22b4b54 in Status: IN_PROGRESS for 2s [ 754.732525] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fc0ae2a8-a235-4d05-9f57-5fec83d37151',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.737076] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.886778] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 14d1a136-a110-4aca-baed-5e7c68a0ccb5 with status ACTIVE [ 754.887087] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.887285] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.887384] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.887651] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.887770] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.888236] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.888388] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.889278] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.889520] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.889643] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.889941] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.890049] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.890966] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.891171] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.891258] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.891352] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 14d1a136-a110-4aca-baed-5e7c68a0ccb5 is going to be updated. [ 754.897666] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc0ae2a8-a235-4d05-9f57-5fec83d37151 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.897666] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc0ae2a8-a235-4d05-9f57-5fec83d37151" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.897666] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.897666] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.916615] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.916615] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.916615] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.916615] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.916615] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.916615] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14d1a136-a110-4aca-baed-5e7c68a0ccb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.236442] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fc0ae2a8-a235-4d05-9f57-5fec83d37151',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.241037] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.312085] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a793445b-22a7-4c79-b31c-1beebe657659 in Status: SUCCESS [ 755.312411] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.741181] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.741451] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.741451] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.741601] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.741684] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.741787] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc0ae2a8-a235-4d05-9f57-5fec83d37151 is going to be created. [ 755.744631] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.744786] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.744868] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.745034] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.745126] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.745263] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b is going to be updated. [ 755.763636] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.763828] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.763874] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.764157] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.764266] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.767063] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.767249] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.767249] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.767441] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.767575] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.773716] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc0ae2a8-a235-4d05-9f57-5fec83d37151 in Status: UNINITIALIZED for 2s [ 755.774114] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b in Status: IN_PROGRESS for 2s [ 756.256967] env[70764]: INFO networking_nsxv3.common.synchronization [None req-499212bb-9823-4375-b7bb-6bf7be0d4cd6 None None] Enqueued Resource ID: b477a0d6-192f-47f2-88ad-4d0f6c1007ee with Priority: HIGHEST for action port [ 756.257286] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b477a0d6-192f-47f2-88ad-4d0f6c1007ee with Priority: HIGHEST for action port [ 756.257825] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-b477a0d6-192f-47f2-88ad-4d0f6c1007ee taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.258613] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b477a0d6-192f-47f2-88ad-4d0f6c1007ee" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.258613] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b477a0d6-192f-47f2-88ad-4d0f6c1007ee" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.258613] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b477a0d6-192f-47f2-88ad-4d0f6c1007ee" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.258613] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b477a0d6-192f-47f2-88ad-4d0f6c1007ee',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.366668] env[70764]: INFO networking_nsxv3.common.synchronization [req-5f5ae268-3cd2-48a0-9528-09001f134514 req-7322f556-0b6c-410d-b998-f2e74635f3de tempest-AttachVolumeTestJSON-503324066 tempest-AttachVolumeTestJSON-503324066-project-member] Enqueued Resource ID: 6e903658-277d-417d-95d4-4fcc19078cba with Priority: HIGHEST for action security_group_members [ 756.367209] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e903658-277d-417d-95d4-4fcc19078cba with Priority: HIGHEST for action security_group_members [ 756.367504] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e903658-277d-417d-95d4-4fcc19078cba taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.367621] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e903658-277d-417d-95d4-4fcc19078cba" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.367786] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e903658-277d-417d-95d4-4fcc19078cba" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.367937] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e903658-277d-417d-95d4-4fcc19078cba" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.368114] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.368203] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.368263] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.368408] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.368486] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.368574] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e903658-277d-417d-95d4-4fcc19078cba',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.502197] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb6f4eb6-36d0-4604-a204-4c47b22b4b54 in Status: SUCCESS [ 756.502414] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb6f4eb6-36d0-4604-a204-4c47b22b4b54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.762909] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b477a0d6-192f-47f2-88ad-4d0f6c1007ee [ 756.762909] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.762909] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.762909] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.762909] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.762909] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.762909] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b477a0d6-192f-47f2-88ad-4d0f6c1007ee already deleted. [ 756.762909] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b477a0d6-192f-47f2-88ad-4d0f6c1007ee" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.870860] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.871046] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.871127] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.871339] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.871431] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.871623] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.871724] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.871786] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.871959] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.872049] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.872136] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e903658-277d-417d-95d4-4fcc19078cba already deleted. [ 756.872220] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e903658-277d-417d-95d4-4fcc19078cba" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.174131] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-680 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.174131] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-680" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.174131] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-680" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.174131] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-680" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.174676] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.174783] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.174924] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.175386] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.175559] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.175787] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 757.175897] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 757.176017] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 757.176158] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 757.176289] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 757.176402] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 757.176546] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 757.200115] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 757.200483] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 757.200483] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 757.200591] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-680" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.201056] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-fdc58e77-3566-4b9d-86a6-32dddb187fe2 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.201268] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-fdc58e77-3566-4b9d-86a6-32dddb187fe2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.201398] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-fdc58e77-3566-4b9d-86a6-32dddb187fe2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.201732] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-fdc58e77-3566-4b9d-86a6-32dddb187fe2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.201904] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fdc58e77-3566-4b9d-86a6-32dddb187fe2',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.223912] env[70764]: INFO networking_nsxv3.common.synchronization [None req-9e4005a7-a3bd-49e4-b8cc-0e2d9f74ef06 None None] Enqueued Resource ID: 6be2b77d-0cf2-4ecf-ae59-b5fef724551f with Priority: HIGHEST for action port [ 757.224295] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6be2b77d-0cf2-4ecf-ae59-b5fef724551f with Priority: HIGHEST for action port [ 757.225094] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-6be2b77d-0cf2-4ecf-ae59-b5fef724551f taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.225094] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6be2b77d-0cf2-4ecf-ae59-b5fef724551f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.225094] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6be2b77d-0cf2-4ecf-ae59-b5fef724551f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.226073] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6be2b77d-0cf2-4ecf-ae59-b5fef724551f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.226269] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6be2b77d-0cf2-4ecf-ae59-b5fef724551f',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.705721] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.706079] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.706124] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.706376] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.707224] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.707224] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port fdc58e77-3566-4b9d-86a6-32dddb187fe2 not found, creating... [ 757.707224] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.707224] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.707224] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.707458] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.707640] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.707786] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.707979] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.708434] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.708434] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.708434] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.708568] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: fdc58e77-3566-4b9d-86a6-32dddb187fe2 is going to be created. [ 757.728305] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6be2b77d-0cf2-4ecf-ae59-b5fef724551f [ 757.728571] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.728732] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.728810] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.729029] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.729108] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.729204] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6be2b77d-0cf2-4ecf-ae59-b5fef724551f already deleted. [ 757.729279] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6be2b77d-0cf2-4ecf-ae59-b5fef724551f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.730422] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.730591] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.730704] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.730952] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.733017] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.733017] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-fdc58e77-3566-4b9d-86a6-32dddb187fe2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.786678] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc0ae2a8-a235-4d05-9f57-5fec83d37151 in Status: SUCCESS [ 757.787513] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc0ae2a8-a235-4d05-9f57-5fec83d37151" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.787513] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc0ae2a8-a235-4d05-9f57-5fec83d37151" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.787513] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc0ae2a8-a235-4d05-9f57-5fec83d37151" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.787642] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.787642] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.787742] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.787855] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.787929] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.788033] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc0ae2a8-a235-4d05-9f57-5fec83d37151',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.789491] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b in Status: SUCCESS [ 757.789668] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.789824] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.789984] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.790152] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.790256] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.790317] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.790456] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.790532] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.790617] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.985496] env[70764]: INFO networking_nsxv3.common.synchronization [req-348b3f44-3436-46f8-bf0c-73a07f6bd081 req-0a9425a3-5d60-42cc-b3de-37d8053cf12e tempest-ImagesTestJSON-1647743380 tempest-ImagesTestJSON-1647743380-project-member] Enqueued Resource ID: 4580d502-1d18-4681-96a4-28ac4e291d69 with Priority: HIGHEST for action security_group_members [ 757.986046] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4580d502-1d18-4681-96a4-28ac4e291d69 with Priority: HIGHEST for action security_group_members [ 757.986355] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4580d502-1d18-4681-96a4-28ac4e291d69 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.986474] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.986537] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.986728] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.986875] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.986962] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.987473] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.987673] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.987762] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.987871] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4580d502-1d18-4681-96a4-28ac4e291d69',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.293595] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fc0ae2a8-a235-4d05-9f57-5fec83d37151',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.296513] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.298316] env[70764]: INFO networking_nsxv3.common.synchronization [None req-b3bee612-c597-47fd-943e-9014e629bd49 None None] Enqueued Resource ID: 75e472c9-4714-467c-9e72-cab799fa44ee with Priority: HIGHEST for action port [ 758.299033] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75e472c9-4714-467c-9e72-cab799fa44ee with Priority: HIGHEST for action port [ 758.299692] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-75e472c9-4714-467c-9e72-cab799fa44ee taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.299692] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75e472c9-4714-467c-9e72-cab799fa44ee" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.299692] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75e472c9-4714-467c-9e72-cab799fa44ee" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.299934] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75e472c9-4714-467c-9e72-cab799fa44ee" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.299979] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75e472c9-4714-467c-9e72-cab799fa44ee',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.490339] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.490502] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.490573] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.490789] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.490916] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.491147] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.491254] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.491316] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.491466] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.491543] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.491633] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4580d502-1d18-4681-96a4-28ac4e291d69 is going to be updated. [ 758.520135] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.520135] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.520135] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.520135] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.520135] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.528141] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4580d502-1d18-4681-96a4-28ac4e291d69 in Status: IN_PROGRESS for 2s [ 758.549887] env[70764]: INFO networking_nsxv3.common.synchronization [None req-a6424cd5-be67-42f4-bf6d-cede3c9fa66d tempest-AttachVolumeShelveTestJSON-384280106 tempest-AttachVolumeShelveTestJSON-384280106-project-member] Enqueued Resource ID: 9c661804-19d8-4b01-b7d8-b4d1885cc85f with Priority: HIGHEST for action security_group_rules [ 758.552576] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c661804-19d8-4b01-b7d8-b4d1885cc85f with Priority: HIGHEST for action security_group_rules [ 758.554175] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c661804-19d8-4b01-b7d8-b4d1885cc85f taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.555434] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.555559] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.555874] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.556839] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c661804-19d8-4b01-b7d8-b4d1885cc85f',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.617178] env[70764]: INFO networking_nsxv3.common.synchronization [req-5f5ae268-3cd2-48a0-9528-09001f134514 req-5847ef82-f4c6-4979-bae3-4519da35ab92 service nova] Enqueued Resource ID: 6e903658-277d-417d-95d4-4fcc19078cba with Priority: HIGHEST for action security_group_rules [ 758.617178] env[70764]: INFO networking_nsxv3.common.synchronization [req-5f5ae268-3cd2-48a0-9528-09001f134514 req-5847ef82-f4c6-4979-bae3-4519da35ab92 service nova] Enqueued Resource ID: 6e903658-277d-417d-95d4-4fcc19078cba with Priority: HIGHEST for action security_group_members [ 758.617178] env[70764]: INFO networking_nsxv3.common.synchronization [req-5f5ae268-3cd2-48a0-9528-09001f134514 req-5847ef82-f4c6-4979-bae3-4519da35ab92 service nova] Enqueued Resource ID: fdc58e77-3566-4b9d-86a6-32dddb187fe2 with Priority: HIGHEST for action port [ 758.617178] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e903658-277d-417d-95d4-4fcc19078cba with Priority: HIGHEST for action security_group_rules [ 758.617178] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e903658-277d-417d-95d4-4fcc19078cba with Priority: HIGHEST for action security_group_members [ 758.617178] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdc58e77-3566-4b9d-86a6-32dddb187fe2 with Priority: HIGHEST for action port [ 758.619945] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e903658-277d-417d-95d4-4fcc19078cba taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.620274] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e903658-277d-417d-95d4-4fcc19078cba" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.620494] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e903658-277d-417d-95d4-4fcc19078cba" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.625022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e903658-277d-417d-95d4-4fcc19078cba" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.625022] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e903658-277d-417d-95d4-4fcc19078cba',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.625022] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e903658-277d-417d-95d4-4fcc19078cba taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.625022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e903658-277d-417d-95d4-4fcc19078cba" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.625022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e903658-277d-417d-95d4-4fcc19078cba" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.625022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e903658-277d-417d-95d4-4fcc19078cba" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.625022] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.625022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.625022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.625022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.625022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.625022] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e903658-277d-417d-95d4-4fcc19078cba',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.625022] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-fdc58e77-3566-4b9d-86a6-32dddb187fe2 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.625022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fdc58e77-3566-4b9d-86a6-32dddb187fe2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.625022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fdc58e77-3566-4b9d-86a6-32dddb187fe2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.625022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fdc58e77-3566-4b9d-86a6-32dddb187fe2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.625022] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fdc58e77-3566-4b9d-86a6-32dddb187fe2',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.632257] env[70764]: INFO networking_nsxv3.common.synchronization [req-cbb2c534-6713-4ba1-abbd-3481adcc7820 req-d56d24d4-e735-4517-90b9-46ebc90e5972 tempest-ServerActionsTestJSON-288318646 tempest-ServerActionsTestJSON-288318646-project-member] Enqueued Resource ID: 527aa039-9b45-4682-bffb-ac71e24551a1 with Priority: HIGHEST for action security_group_members [ 758.633062] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 527aa039-9b45-4682-bffb-ac71e24551a1 with Priority: HIGHEST for action security_group_members [ 758.633449] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-527aa039-9b45-4682-bffb-ac71e24551a1 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.633684] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.633865] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.637401] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.637401] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.637401] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.637401] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.637401] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.637401] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.637401] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('527aa039-9b45-4682-bffb-ac71e24551a1',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.679422] env[70764]: INFO networking_nsxv3.common.synchronization [None req-ec235361-66f5-4b8a-8040-994e5f6c2e1b tempest-AttachVolumeShelveTestJSON-384280106 tempest-AttachVolumeShelveTestJSON-384280106-project-member] Enqueued Resource ID: 9c661804-19d8-4b01-b7d8-b4d1885cc85f with Priority: HIGHEST for action security_group_rules [ 758.679422] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c661804-19d8-4b01-b7d8-b4d1885cc85f with Priority: HIGHEST for action security_group_rules [ 758.679422] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c661804-19d8-4b01-b7d8-b4d1885cc85f taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.679422] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.798773] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.799809] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fc0ae2a8-a235-4d05-9f57-5fec83d37151',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.801229] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 75e472c9-4714-467c-9e72-cab799fa44ee [ 758.801453] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.801584] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.801647] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.801849] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.801929] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.802073] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:75e472c9-4714-467c-9e72-cab799fa44ee already deleted. [ 758.802121] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75e472c9-4714-467c-9e72-cab799fa44ee" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.078622] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.078733] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.078733] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.079046] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.079134] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.079255] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c661804-19d8-4b01-b7d8-b4d1885cc85f already deleted. [ 759.079358] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.079528] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.079710] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.079819] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c661804-19d8-4b01-b7d8-b4d1885cc85f',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.130396] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e903658-277d-417d-95d4-4fcc19078cba taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.130513] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e903658-277d-417d-95d4-4fcc19078cba" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.130719] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e903658-277d-417d-95d4-4fcc19078cba',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.133179] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fdc58e77-3566-4b9d-86a6-32dddb187fe2 with status ACTIVE [ 759.133369] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.133484] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.133549] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.133745] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.133835] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.134010] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.134111] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.134172] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.134318] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.134393] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.134578] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.134657] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.134707] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.134842] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.134915] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.134997] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fdc58e77-3566-4b9d-86a6-32dddb187fe2 is going to be updated. [ 759.139124] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.139233] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.139336] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.139502] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.139584] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.139758] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.139852] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.139922] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.140109] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.140187] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.140274] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 527aa039-9b45-4682-bffb-ac71e24551a1 already deleted. [ 759.140351] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.155774] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.155938] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.156031] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.156223] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.156418] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.156505] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fdc58e77-3566-4b9d-86a6-32dddb187fe2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.176713] env[70764]: INFO networking_nsxv3.common.synchronization [None req-1bd935eb-3a4e-4da2-9bc9-20e0ac6c2126 None None] Enqueued Resource ID: b9b75af9-cdc0-43a8-acef-8b95c277cad0 with Priority: HIGHEST for action port [ 759.177060] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9b75af9-cdc0-43a8-acef-8b95c277cad0 with Priority: HIGHEST for action port [ 759.177524] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9b75af9-cdc0-43a8-acef-8b95c277cad0 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.177642] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9b75af9-cdc0-43a8-acef-8b95c277cad0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.177705] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9b75af9-cdc0-43a8-acef-8b95c277cad0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.177948] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9b75af9-cdc0-43a8-acef-8b95c277cad0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.178039] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9b75af9-cdc0-43a8-acef-8b95c277cad0',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.246956] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-803 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.246956] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-803" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.246956] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-803" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.246956] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-803" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.246956] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.247273] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.247273] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.250562] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.250562] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.250562] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 759.250562] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 759.250562] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 759.250562] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 759.250562] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 759.250562] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 759.250562] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 759.269425] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 759.269587] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 759.269726] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 759.269900] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-803" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.270239] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-3323e7ff-08f6-4a96-9aec-9b5b16577f27 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.270448] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-3323e7ff-08f6-4a96-9aec-9b5b16577f27" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.270534] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-3323e7ff-08f6-4a96-9aec-9b5b16577f27" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.273368] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-3323e7ff-08f6-4a96-9aec-9b5b16577f27" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.273368] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3323e7ff-08f6-4a96-9aec-9b5b16577f27',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.301318] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.301500] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.301544] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.301726] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.301818] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.301921] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b is going to be updated. [ 759.303558] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.303667] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.303739] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.303927] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.303983] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.304068] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc0ae2a8-a235-4d05-9f57-5fec83d37151 is going to be updated. [ 759.347254] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.347437] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.347534] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.347708] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.347850] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.349455] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.349567] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.349633] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.349804] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.349920] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.358598] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc0ae2a8-a235-4d05-9f57-5fec83d37151 in Status: IN_PROGRESS for 2s [ 759.359216] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b in Status: IN_PROGRESS for 2s [ 759.599933] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.600090] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.600158] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.600366] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.600451] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.600541] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c661804-19d8-4b01-b7d8-b4d1885cc85f already deleted. [ 759.600619] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.635068] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e903658-277d-417d-95d4-4fcc19078cba',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.683618] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b9b75af9-cdc0-43a8-acef-8b95c277cad0 [ 759.687019] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.687019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.687019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.687019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.687019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.687019] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b9b75af9-cdc0-43a8-acef-8b95c277cad0 already deleted. [ 759.687019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9b75af9-cdc0-43a8-acef-8b95c277cad0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.773773] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.774107] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.775412] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.775628] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.775788] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.775946] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 3323e7ff-08f6-4a96-9aec-9b5b16577f27 not found, creating... [ 759.776300] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.776484] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.776572] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.776794] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.777068] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.777280] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.777434] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.777549] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.777843] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.777900] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.778024] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 3323e7ff-08f6-4a96-9aec-9b5b16577f27 is going to be created. [ 759.800311] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.800622] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.800725] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.801073] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.801330] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.801810] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-3323e7ff-08f6-4a96-9aec-9b5b16577f27" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.138075] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.138248] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.138338] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.138615] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.138701] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.138805] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e903658-277d-417d-95d4-4fcc19078cba is going to be created. [ 760.168300] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.168300] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.168300] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.168300] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.168493] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.185847] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e903658-277d-417d-95d4-4fcc19078cba in Status: UNINITIALIZED for 2s [ 760.538198] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4580d502-1d18-4681-96a4-28ac4e291d69 in Status: SUCCESS [ 760.538393] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4580d502-1d18-4681-96a4-28ac4e291d69 deletion is rescheduled due to dependency. [ 760.538444] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.698208] env[70764]: INFO networking_nsxv3.common.synchronization [req-cbb2c534-6713-4ba1-abbd-3481adcc7820 req-c310d9d6-e578-4263-9396-c3a9e7a4025f service nova] Enqueued Resource ID: 527aa039-9b45-4682-bffb-ac71e24551a1 with Priority: HIGHEST for action security_group_rules [ 760.698208] env[70764]: INFO networking_nsxv3.common.synchronization [req-cbb2c534-6713-4ba1-abbd-3481adcc7820 req-c310d9d6-e578-4263-9396-c3a9e7a4025f service nova] Enqueued Resource ID: 527aa039-9b45-4682-bffb-ac71e24551a1 with Priority: HIGHEST for action security_group_members [ 760.698208] env[70764]: INFO networking_nsxv3.common.synchronization [req-cbb2c534-6713-4ba1-abbd-3481adcc7820 req-c310d9d6-e578-4263-9396-c3a9e7a4025f service nova] Enqueued Resource ID: 3323e7ff-08f6-4a96-9aec-9b5b16577f27 with Priority: HIGHEST for action port [ 760.698208] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 527aa039-9b45-4682-bffb-ac71e24551a1 with Priority: HIGHEST for action security_group_rules [ 760.698208] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 527aa039-9b45-4682-bffb-ac71e24551a1 with Priority: HIGHEST for action security_group_members [ 760.698208] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3323e7ff-08f6-4a96-9aec-9b5b16577f27 with Priority: HIGHEST for action port [ 760.698520] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-527aa039-9b45-4682-bffb-ac71e24551a1 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.698585] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.698661] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.698877] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.698966] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('527aa039-9b45-4682-bffb-ac71e24551a1',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.700764] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-527aa039-9b45-4682-bffb-ac71e24551a1 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.700897] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.701089] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.701862] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.702086] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.702209] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.702288] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.702453] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.702559] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.702695] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('527aa039-9b45-4682-bffb-ac71e24551a1',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.703432] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-3323e7ff-08f6-4a96-9aec-9b5b16577f27 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.703540] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3323e7ff-08f6-4a96-9aec-9b5b16577f27" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.703627] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3323e7ff-08f6-4a96-9aec-9b5b16577f27" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.703803] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3323e7ff-08f6-4a96-9aec-9b5b16577f27" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.704050] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3323e7ff-08f6-4a96-9aec-9b5b16577f27',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.205783] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-527aa039-9b45-4682-bffb-ac71e24551a1 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.205783] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.205783] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('527aa039-9b45-4682-bffb-ac71e24551a1',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.206845] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3323e7ff-08f6-4a96-9aec-9b5b16577f27 with status ACTIVE [ 761.206989] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.206989] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.207089] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.207641] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.207641] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.207641] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.207641] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.207641] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.207839] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.208217] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.208217] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.208217] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.208402] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.208614] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.208614] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.208690] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3323e7ff-08f6-4a96-9aec-9b5b16577f27 is going to be updated. [ 761.249023] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.249023] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.249023] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.249023] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.249023] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.249023] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3323e7ff-08f6-4a96-9aec-9b5b16577f27" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.369446] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc0ae2a8-a235-4d05-9f57-5fec83d37151 in Status: SUCCESS [ 761.369665] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc0ae2a8-a235-4d05-9f57-5fec83d37151" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.369832] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc0ae2a8-a235-4d05-9f57-5fec83d37151" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.370040] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc0ae2a8-a235-4d05-9f57-5fec83d37151" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.370226] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.370340] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.370403] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.370554] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.370640] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.370714] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc0ae2a8-a235-4d05-9f57-5fec83d37151" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.370803] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fc0ae2a8-a235-4d05-9f57-5fec83d37151',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.372178] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b in Status: SUCCESS [ 761.372358] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.372514] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.372651] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.372804] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.372907] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.372958] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.373111] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.373189] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.373271] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.373358] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.584854] env[70764]: INFO networking_nsxv3.common.synchronization [req-3415e7ea-9606-4919-bf7c-18f70f9ef310 req-7d9123aa-abde-40fc-91b2-5a84046bf10c tempest-SecurityGroupsTestJSON-512195178 tempest-SecurityGroupsTestJSON-512195178-project-member] Enqueued Resource ID: fc0ae2a8-a235-4d05-9f57-5fec83d37151 with Priority: HIGHEST for action security_group_members [ 761.585034] env[70764]: INFO networking_nsxv3.common.synchronization [req-3415e7ea-9606-4919-bf7c-18f70f9ef310 req-7d9123aa-abde-40fc-91b2-5a84046bf10c tempest-SecurityGroupsTestJSON-512195178 tempest-SecurityGroupsTestJSON-512195178-project-member] Enqueued Resource ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b with Priority: HIGHEST for action security_group_members [ 761.586072] env[70764]: INFO networking_nsxv3.common.synchronization [req-3415e7ea-9606-4919-bf7c-18f70f9ef310 req-7d9123aa-abde-40fc-91b2-5a84046bf10c tempest-SecurityGroupsTestJSON-512195178 tempest-SecurityGroupsTestJSON-512195178-project-member] Enqueued Resource ID: e30e2153-2e8b-4b47-9977-1856fb2d6991 with Priority: HIGHEST for action security_group_members [ 761.586072] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc0ae2a8-a235-4d05-9f57-5fec83d37151 with Priority: HIGHEST for action security_group_members [ 761.586072] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b with Priority: HIGHEST for action security_group_members [ 761.586429] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e30e2153-2e8b-4b47-9977-1856fb2d6991 with Priority: HIGHEST for action security_group_members [ 761.586741] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc0ae2a8-a235-4d05-9f57-5fec83d37151 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.586846] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc0ae2a8-a235-4d05-9f57-5fec83d37151" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.586913] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc0ae2a8-a235-4d05-9f57-5fec83d37151" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.587117] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc0ae2a8-a235-4d05-9f57-5fec83d37151" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.587265] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.587396] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.587438] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.587556] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.587637] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.587730] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc0ae2a8-a235-4d05-9f57-5fec83d37151',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.588567] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.588684] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.588747] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.588913] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.589064] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.589159] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.590478] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.590661] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.590751] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.590864] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.591598] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-e30e2153-2e8b-4b47-9977-1856fb2d6991 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.591702] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e30e2153-2e8b-4b47-9977-1856fb2d6991" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.591773] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e30e2153-2e8b-4b47-9977-1856fb2d6991" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.592010] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e30e2153-2e8b-4b47-9977-1856fb2d6991" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.592159] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.592257] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.592319] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.592457] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.592531] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.592613] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e30e2153-2e8b-4b47-9977-1856fb2d6991',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.694796] env[70764]: INFO networking_nsxv3.common.synchronization [req-3415e7ea-9606-4919-bf7c-18f70f9ef310 req-7d9123aa-abde-40fc-91b2-5a84046bf10c tempest-SecurityGroupsTestJSON-512195178 tempest-SecurityGroupsTestJSON-512195178-project-member] Enqueued Resource ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b with Priority: HIGHEST for action security_group_rules [ 761.694970] env[70764]: INFO networking_nsxv3.common.synchronization [req-3415e7ea-9606-4919-bf7c-18f70f9ef310 req-7d9123aa-abde-40fc-91b2-5a84046bf10c tempest-SecurityGroupsTestJSON-512195178 tempest-SecurityGroupsTestJSON-512195178-project-member] Enqueued Resource ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b with Priority: HIGHEST for action security_group_members [ 761.695122] env[70764]: INFO networking_nsxv3.common.synchronization [req-3415e7ea-9606-4919-bf7c-18f70f9ef310 req-7d9123aa-abde-40fc-91b2-5a84046bf10c tempest-SecurityGroupsTestJSON-512195178 tempest-SecurityGroupsTestJSON-512195178-project-member] Enqueued Resource ID: e30e2153-2e8b-4b47-9977-1856fb2d6991 with Priority: HIGHEST for action security_group_rules [ 761.695249] env[70764]: INFO networking_nsxv3.common.synchronization [req-3415e7ea-9606-4919-bf7c-18f70f9ef310 req-7d9123aa-abde-40fc-91b2-5a84046bf10c tempest-SecurityGroupsTestJSON-512195178 tempest-SecurityGroupsTestJSON-512195178-project-member] Enqueued Resource ID: e30e2153-2e8b-4b47-9977-1856fb2d6991 with Priority: HIGHEST for action security_group_members [ 761.695375] env[70764]: INFO networking_nsxv3.common.synchronization [req-3415e7ea-9606-4919-bf7c-18f70f9ef310 req-7d9123aa-abde-40fc-91b2-5a84046bf10c tempest-SecurityGroupsTestJSON-512195178 tempest-SecurityGroupsTestJSON-512195178-project-member] Enqueued Resource ID: fc0ae2a8-a235-4d05-9f57-5fec83d37151 with Priority: HIGHEST for action security_group_rules [ 761.695544] env[70764]: INFO networking_nsxv3.common.synchronization [req-3415e7ea-9606-4919-bf7c-18f70f9ef310 req-7d9123aa-abde-40fc-91b2-5a84046bf10c tempest-SecurityGroupsTestJSON-512195178 tempest-SecurityGroupsTestJSON-512195178-project-member] Enqueued Resource ID: fc0ae2a8-a235-4d05-9f57-5fec83d37151 with Priority: HIGHEST for action security_group_members [ 761.695682] env[70764]: INFO networking_nsxv3.common.synchronization [req-3415e7ea-9606-4919-bf7c-18f70f9ef310 req-7d9123aa-abde-40fc-91b2-5a84046bf10c tempest-SecurityGroupsTestJSON-512195178 tempest-SecurityGroupsTestJSON-512195178-project-member] Enqueued Resource ID: 14d1a136-a110-4aca-baed-5e7c68a0ccb5 with Priority: HIGHEST for action port [ 761.698042] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b with Priority: HIGHEST for action security_group_rules [ 761.698807] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e30e2153-2e8b-4b47-9977-1856fb2d6991 with Priority: HIGHEST for action security_group_rules [ 761.698948] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc0ae2a8-a235-4d05-9f57-5fec83d37151 with Priority: HIGHEST for action security_group_members [ 761.699077] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14d1a136-a110-4aca-baed-5e7c68a0ccb5 with Priority: HIGHEST for action port [ 761.699176] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc0ae2a8-a235-4d05-9f57-5fec83d37151 with Priority: HIGHEST for action security_group_rules [ 761.699265] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b with Priority: HIGHEST for action security_group_members [ 761.699352] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e30e2153-2e8b-4b47-9977-1856fb2d6991 with Priority: HIGHEST for action security_group_members [ 761.699931] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c2d79e00-b6b0-41f3-96fb-49ab2b10751b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.700074] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.700358] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e30e2153-2e8b-4b47-9977-1856fb2d6991 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.700427] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e30e2153-2e8b-4b47-9977-1856fb2d6991" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.700476] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e30e2153-2e8b-4b47-9977-1856fb2d6991" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.700699] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e30e2153-2e8b-4b47-9977-1856fb2d6991" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.700779] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e30e2153-2e8b-4b47-9977-1856fb2d6991',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.702170] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc0ae2a8-a235-4d05-9f57-5fec83d37151 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.702170] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc0ae2a8-a235-4d05-9f57-5fec83d37151" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.702170] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-14d1a136-a110-4aca-baed-5e7c68a0ccb5 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.702376] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14d1a136-a110-4aca-baed-5e7c68a0ccb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.702514] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14d1a136-a110-4aca-baed-5e7c68a0ccb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.702723] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14d1a136-a110-4aca-baed-5e7c68a0ccb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.702830] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14d1a136-a110-4aca-baed-5e7c68a0ccb5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.703850] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc0ae2a8-a235-4d05-9f57-5fec83d37151 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.703850] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc0ae2a8-a235-4d05-9f57-5fec83d37151" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.703850] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.703970] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.704163] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-e30e2153-2e8b-4b47-9977-1856fb2d6991 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.704294] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e30e2153-2e8b-4b47-9977-1856fb2d6991" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.710991] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('527aa039-9b45-4682-bffb-ac71e24551a1',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.875310] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fc0ae2a8-a235-4d05-9f57-5fec83d37151',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.876356] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.876588] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.097290] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.097290] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fc0ae2a8-a235-4d05-9f57-5fec83d37151',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.097991] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e30e2153-2e8b-4b47-9977-1856fb2d6991',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.197255] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e903658-277d-417d-95d4-4fcc19078cba in Status: SUCCESS [ 762.197586] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e903658-277d-417d-95d4-4fcc19078cba" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.197713] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e903658-277d-417d-95d4-4fcc19078cba" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.198015] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e903658-277d-417d-95d4-4fcc19078cba" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.198307] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.198455] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.198532] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.198854] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.198957] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.199069] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e903658-277d-417d-95d4-4fcc19078cba" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.199164] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6e903658-277d-417d-95d4-4fcc19078cba',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.206296] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-e30e2153-2e8b-4b47-9977-1856fb2d6991 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.206296] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e30e2153-2e8b-4b47-9977-1856fb2d6991" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.207585] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 14d1a136-a110-4aca-baed-5e7c68a0ccb5 with status ACTIVE [ 762.207912] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.207996] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.208088] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.208620] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.208743] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.208961] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.209093] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.209146] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.209332] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.209395] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.209819] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.209819] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.209819] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.210046] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.210046] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.210209] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 14d1a136-a110-4aca-baed-5e7c68a0ccb5 is going to be updated. [ 762.216017] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.216184] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.216250] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.216432] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.216508] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.216603] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 527aa039-9b45-4682-bffb-ac71e24551a1 is going to be created. [ 762.240024] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.240535] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.240535] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.240535] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.240725] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.240780] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14d1a136-a110-4aca-baed-5e7c68a0ccb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.245892] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.246048] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.246121] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.246276] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.246438] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.258234] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 527aa039-9b45-4682-bffb-ac71e24551a1 in Status: UNINITIALIZED for 2s [ 762.378645] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fc0ae2a8-a235-4d05-9f57-5fec83d37151: rpc.has_security_group_logging(os_id): False [ 762.399052] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.399379] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.399548] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.399839] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.400035] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.400366] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.402018] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.402018] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.402018] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.402018] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.402018] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc0ae2a8-a235-4d05-9f57-5fec83d37151 is going to be created. [ 762.423033] env[70764]: INFO networking_nsxv3.common.synchronization [req-55ad4c54-8581-4137-a345-57df889b3160 req-3592586d-9b1b-4d00-86ee-ba054d208b1d tempest-TenantUsagesTestJSON-1579100380 tempest-TenantUsagesTestJSON-1579100380-project-member] Enqueued Resource ID: c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c with Priority: HIGHEST for action security_group_members [ 762.423033] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c with Priority: HIGHEST for action security_group_members [ 762.423033] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.423033] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.423033] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.423033] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.423033] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.423033] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.423033] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.423644] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.423827] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.424011] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.461872] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.461872] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.461872] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.461872] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.462215] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.471153] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc0ae2a8-a235-4d05-9f57-5fec83d37151 in Status: IN_PROGRESS for 2s [ 762.602873] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.603816] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e30e2153-2e8b-4b47-9977-1856fb2d6991',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.604629] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fc0ae2a8-a235-4d05-9f57-5fec83d37151',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.701586] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6e903658-277d-417d-95d4-4fcc19078cba',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.928186] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.928186] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.928186] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.928186] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.928186] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.928186] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.928186] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.928186] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.928186] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.928186] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.928186] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c already deleted. [ 762.928186] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.028160] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-343 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.028160] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-343" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.028160] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-343" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.028160] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-343" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.028160] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.028160] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.028160] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.028160] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.028160] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.028551] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 763.028655] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 763.028797] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 763.029028] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 763.029233] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 763.029390] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 763.029521] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 763.047441] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 763.047679] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 763.047957] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 763.048043] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-343" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.048384] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-58054ace-d177-4f16-a7eb-8ca718a16ca4 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.048733] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-58054ace-d177-4f16-a7eb-8ca718a16ca4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.048733] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-58054ace-d177-4f16-a7eb-8ca718a16ca4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.048971] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-58054ace-d177-4f16-a7eb-8ca718a16ca4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.049109] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58054ace-d177-4f16-a7eb-8ca718a16ca4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.106596] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.106752] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.106821] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.107059] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.107142] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.107238] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e30e2153-2e8b-4b47-9977-1856fb2d6991 is going to be created. [ 763.109490] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.109827] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.109989] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.110370] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.110555] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.110760] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b is going to be updated. [ 763.112041] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.112282] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.112452] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.112693] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.112863] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.113040] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc0ae2a8-a235-4d05-9f57-5fec83d37151 is going to be updated. [ 763.141667] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.141824] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.141909] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.142153] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.142314] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.145207] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.145376] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.145522] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.145763] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.145950] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.147456] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.148062] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.148188] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.148443] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.148597] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.151025] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e30e2153-2e8b-4b47-9977-1856fb2d6991 in Status: UNINITIALIZED for 2s [ 763.156483] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc0ae2a8-a235-4d05-9f57-5fec83d37151 in Status: IN_PROGRESS for 2s [ 763.158013] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b in Status: IN_PROGRESS for 2s [ 763.204136] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6e903658-277d-417d-95d4-4fcc19078cba: rpc.has_security_group_logging(os_id): False [ 763.236307] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.236307] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.236307] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.236307] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.236307] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.236307] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.236307] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.236307] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.236307] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.236307] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.236307] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e903658-277d-417d-95d4-4fcc19078cba is going to be created. [ 763.303538] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.303538] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.303681] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.303816] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.305275] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.318520] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e903658-277d-417d-95d4-4fcc19078cba in Status: IN_PROGRESS for 2s [ 763.553327] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.553807] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.554064] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.554437] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.554858] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.555066] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 58054ace-d177-4f16-a7eb-8ca718a16ca4 not found, creating... [ 763.555867] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.555867] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.555867] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.556037] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.556131] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.556545] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.556658] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.556696] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.556892] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.557030] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.557164] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 58054ace-d177-4f16-a7eb-8ca718a16ca4 is going to be created. [ 763.575052] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.575300] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.575344] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.575744] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.575815] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.576040] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-58054ace-d177-4f16-a7eb-8ca718a16ca4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.268110] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 527aa039-9b45-4682-bffb-ac71e24551a1 in Status: SUCCESS [ 764.268338] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.268509] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.268731] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.268925] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.270018] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.270018] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.270209] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.270321] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.271174] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.272057] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('527aa039-9b45-4682-bffb-ac71e24551a1',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.488229] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc0ae2a8-a235-4d05-9f57-5fec83d37151 in Status: SUCCESS [ 764.488229] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc0ae2a8-a235-4d05-9f57-5fec83d37151" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.488229] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc0ae2a8-a235-4d05-9f57-5fec83d37151" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.488229] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc0ae2a8-a235-4d05-9f57-5fec83d37151" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.488229] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc0ae2a8-a235-4d05-9f57-5fec83d37151',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.524793] env[70764]: INFO networking_nsxv3.common.synchronization [req-55ad4c54-8581-4137-a345-57df889b3160 req-9aae8b40-4eb4-4a66-b16c-7c812993c50b service nova] Enqueued Resource ID: c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c with Priority: HIGHEST for action security_group_rules [ 764.525272] env[70764]: INFO networking_nsxv3.common.synchronization [req-55ad4c54-8581-4137-a345-57df889b3160 req-9aae8b40-4eb4-4a66-b16c-7c812993c50b service nova] Enqueued Resource ID: c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c with Priority: HIGHEST for action security_group_members [ 764.525272] env[70764]: INFO networking_nsxv3.common.synchronization [req-55ad4c54-8581-4137-a345-57df889b3160 req-9aae8b40-4eb4-4a66-b16c-7c812993c50b service nova] Enqueued Resource ID: 58054ace-d177-4f16-a7eb-8ca718a16ca4 with Priority: HIGHEST for action port [ 764.525431] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c with Priority: HIGHEST for action security_group_rules [ 764.525719] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c with Priority: HIGHEST for action security_group_members [ 764.525719] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58054ace-d177-4f16-a7eb-8ca718a16ca4 with Priority: HIGHEST for action port [ 764.526182] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.526313] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.526417] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.526670] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.526754] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.528693] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.528813] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.528882] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.529085] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.529345] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.529463] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.529501] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.529731] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.529731] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.529819] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.530936] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-58054ace-d177-4f16-a7eb-8ca718a16ca4 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.531135] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58054ace-d177-4f16-a7eb-8ca718a16ca4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.531190] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58054ace-d177-4f16-a7eb-8ca718a16ca4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.531304] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58054ace-d177-4f16-a7eb-8ca718a16ca4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.531381] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58054ace-d177-4f16-a7eb-8ca718a16ca4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.555848] env[70764]: INFO networking_nsxv3.common.synchronization [req-d626a63b-2f92-4fed-91bb-9eae24d2cc0b req-598afe66-28e8-4cd7-bccc-52862a629d7f tempest-ServersAdminNegativeTestJSON-803035860 tempest-ServersAdminNegativeTestJSON-803035860-project-member] Enqueued Resource ID: a793445b-22a7-4c79-b31c-1beebe657659 with Priority: HIGHEST for action security_group_members [ 764.556523] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a793445b-22a7-4c79-b31c-1beebe657659 with Priority: HIGHEST for action security_group_members [ 764.556857] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-a793445b-22a7-4c79-b31c-1beebe657659 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.556986] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.558057] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.558057] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.558057] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.558057] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.558057] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.558057] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.558057] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.558335] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a793445b-22a7-4c79-b31c-1beebe657659',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.775301] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('527aa039-9b45-4682-bffb-ac71e24551a1',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.989952] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc0ae2a8-a235-4d05-9f57-5fec83d37151 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.990149] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc0ae2a8-a235-4d05-9f57-5fec83d37151" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.029797] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.030062] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.031262] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.036519] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 58054ace-d177-4f16-a7eb-8ca718a16ca4 with status ACTIVE [ 765.036519] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.036519] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.036519] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.036519] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.036519] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.036519] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.036519] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.036519] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.036519] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.036519] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.036519] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.036519] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.036519] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.036519] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.036519] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.036519] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 58054ace-d177-4f16-a7eb-8ca718a16ca4 is going to be updated. [ 765.054345] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.055112] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.055112] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.055112] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.055112] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.055338] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58054ace-d177-4f16-a7eb-8ca718a16ca4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.060539] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a793445b-22a7-4c79-b31c-1beebe657659',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.160077] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e30e2153-2e8b-4b47-9977-1856fb2d6991 in Status: SUCCESS [ 765.160305] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e30e2153-2e8b-4b47-9977-1856fb2d6991" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.160474] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e30e2153-2e8b-4b47-9977-1856fb2d6991" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.160689] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e30e2153-2e8b-4b47-9977-1856fb2d6991" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.160934] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.161089] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.161155] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.161314] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.161396] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.161499] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e30e2153-2e8b-4b47-9977-1856fb2d6991',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.163964] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc0ae2a8-a235-4d05-9f57-5fec83d37151 in Status: SUCCESS [ 765.164158] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc0ae2a8-a235-4d05-9f57-5fec83d37151" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.164307] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc0ae2a8-a235-4d05-9f57-5fec83d37151" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.164477] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc0ae2a8-a235-4d05-9f57-5fec83d37151" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.164644] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.164755] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.164818] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.164962] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.165055] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.165147] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc0ae2a8-a235-4d05-9f57-5fec83d37151',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.175172] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b in Status: SUCCESS [ 765.175332] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.175688] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.175884] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.176072] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.176183] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.176243] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.176392] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.176471] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.176693] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.278630] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 527aa039-9b45-4682-bffb-ac71e24551a1: rpc.has_security_group_logging(os_id): False [ 765.297046] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.297309] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.297309] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.297553] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.297657] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.297874] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.298019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.298113] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.298261] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.298354] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.298728] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 527aa039-9b45-4682-bffb-ac71e24551a1 is going to be created. [ 765.342938] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e903658-277d-417d-95d4-4fcc19078cba in Status: SUCCESS [ 765.343202] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e903658-277d-417d-95d4-4fcc19078cba" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.373054] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.373303] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.373356] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.373597] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.373782] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.385007] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 527aa039-9b45-4682-bffb-ac71e24551a1 in Status: IN_PROGRESS for 2s [ 765.447297] env[70764]: INFO networking_nsxv3.common.synchronization [req-e759e32d-4ae2-4940-9dc4-b570686a0b52 req-9aa62cd0-277b-440f-8397-e43908d540df tempest-SecurityGroupsTestJSON-512195178 tempest-SecurityGroupsTestJSON-512195178-project-member] Enqueued Resource ID: fc0ae2a8-a235-4d05-9f57-5fec83d37151 with Priority: HIGHEST for action security_group_members [ 765.447297] env[70764]: INFO networking_nsxv3.common.synchronization [req-e759e32d-4ae2-4940-9dc4-b570686a0b52 req-9aa62cd0-277b-440f-8397-e43908d540df tempest-SecurityGroupsTestJSON-512195178 tempest-SecurityGroupsTestJSON-512195178-project-member] Enqueued Resource ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b with Priority: HIGHEST for action security_group_members [ 765.447439] env[70764]: INFO networking_nsxv3.common.synchronization [req-e759e32d-4ae2-4940-9dc4-b570686a0b52 req-9aa62cd0-277b-440f-8397-e43908d540df tempest-SecurityGroupsTestJSON-512195178 tempest-SecurityGroupsTestJSON-512195178-project-member] Enqueued Resource ID: e30e2153-2e8b-4b47-9977-1856fb2d6991 with Priority: HIGHEST for action security_group_members [ 765.447845] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc0ae2a8-a235-4d05-9f57-5fec83d37151 with Priority: HIGHEST for action security_group_members [ 765.447976] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b with Priority: HIGHEST for action security_group_members [ 765.448219] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e30e2153-2e8b-4b47-9977-1856fb2d6991 with Priority: HIGHEST for action security_group_members [ 765.448507] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc0ae2a8-a235-4d05-9f57-5fec83d37151 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.448608] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc0ae2a8-a235-4d05-9f57-5fec83d37151" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.448800] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.448908] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.449114] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-e30e2153-2e8b-4b47-9977-1856fb2d6991 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.449207] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e30e2153-2e8b-4b47-9977-1856fb2d6991" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.533816] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.562840] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a793445b-22a7-4c79-b31c-1beebe657659',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.663674] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e30e2153-2e8b-4b47-9977-1856fb2d6991',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.668506] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fc0ae2a8-a235-4d05-9f57-5fec83d37151',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.678833] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.036227] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.036409] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.036485] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.036740] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.036847] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.036956] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c is going to be created. [ 766.059929] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.060140] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.060203] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.060385] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.062836] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.065952] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.065952] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.065952] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.067324] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.067324] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.067324] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a793445b-22a7-4c79-b31c-1beebe657659 is going to be updated. [ 766.076372] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c in Status: UNINITIALIZED for 2s [ 766.098670] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.098806] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.098877] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.099101] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.099404] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.110171] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a793445b-22a7-4c79-b31c-1beebe657659 in Status: IN_PROGRESS for 2s [ 766.169269] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e30e2153-2e8b-4b47-9977-1856fb2d6991',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.170233] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fc0ae2a8-a235-4d05-9f57-5fec83d37151',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.184927] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.673574] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.673898] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.673898] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.674031] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.674130] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.674232] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc0ae2a8-a235-4d05-9f57-5fec83d37151 is going to be updated. [ 766.675501] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.675666] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.675736] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.675909] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.675971] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.676041] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e30e2153-2e8b-4b47-9977-1856fb2d6991 is going to be updated. [ 766.687566] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.688705] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.688705] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.688705] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.693346] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.693346] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b is going to be updated. [ 766.726396] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.726396] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.726396] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.726598] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.726633] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.729110] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.729290] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.729354] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.729539] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.729676] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.737646] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.737806] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.737917] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.738150] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.738293] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.740686] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc0ae2a8-a235-4d05-9f57-5fec83d37151 in Status: IN_PROGRESS for 2s [ 766.741427] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e30e2153-2e8b-4b47-9977-1856fb2d6991 in Status: IN_PROGRESS for 2s [ 766.748995] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b in Status: IN_PROGRESS for 2s [ 767.399423] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 527aa039-9b45-4682-bffb-ac71e24551a1 in Status: SUCCESS [ 767.399756] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.086205] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c in Status: SUCCESS [ 768.086659] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.086659] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.087031] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.087441] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.087441] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.087441] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.087729] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.087729] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.087833] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.087889] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.122313] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a793445b-22a7-4c79-b31c-1beebe657659 in Status: IN_PROGRESS for 4s [ 768.594090] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.594273] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.594338] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.594553] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.594729] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.594831] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.594992] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.595066] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.595153] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.595248] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.595394] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.595478] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.595538] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.595679] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.595920] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.595920] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.596035] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.596145] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.596223] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.596365] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.596439] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.753790] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc0ae2a8-a235-4d05-9f57-5fec83d37151 in Status: SUCCESS [ 768.754146] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc0ae2a8-a235-4d05-9f57-5fec83d37151" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.757137] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e30e2153-2e8b-4b47-9977-1856fb2d6991 in Status: SUCCESS [ 768.757137] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e30e2153-2e8b-4b47-9977-1856fb2d6991" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.757137] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc0ae2a8-a235-4d05-9f57-5fec83d37151" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.757137] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc0ae2a8-a235-4d05-9f57-5fec83d37151" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.757137] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.757137] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.757137] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.757137] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.757137] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.757137] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc0ae2a8-a235-4d05-9f57-5fec83d37151" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.757137] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fc0ae2a8-a235-4d05-9f57-5fec83d37151',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.758084] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e30e2153-2e8b-4b47-9977-1856fb2d6991" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.759277] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e30e2153-2e8b-4b47-9977-1856fb2d6991" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.759277] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.759277] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.759277] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.759277] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.759277] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.759277] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e30e2153-2e8b-4b47-9977-1856fb2d6991" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.759918] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e30e2153-2e8b-4b47-9977-1856fb2d6991',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.761638] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b in Status: SUCCESS [ 768.762045] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.763621] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc0ae2a8-a235-4d05-9f57-5fec83d37151" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.763621] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc0ae2a8-a235-4d05-9f57-5fec83d37151" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.763621] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.763621] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.763621] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.763621] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.763621] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.763621] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc0ae2a8-a235-4d05-9f57-5fec83d37151',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.764294] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e30e2153-2e8b-4b47-9977-1856fb2d6991" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.764558] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e30e2153-2e8b-4b47-9977-1856fb2d6991" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.764814] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.765902] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.765902] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.765902] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.765902] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.765902] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e30e2153-2e8b-4b47-9977-1856fb2d6991',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.768373] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.768373] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.768373] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.768373] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.768373] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.768373] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.768373] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.768373] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.768373] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.768373] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.768373] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.768373] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.768373] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.768373] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.768373] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.768373] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.769443] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.769443] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.769443] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.771932] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.772172] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.772356] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.772482] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.772563] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.772731] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.772833] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.772938] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.100533] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c: rpc.has_security_group_logging(os_id): False [ 769.118072] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.118189] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.118327] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.118464] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.118539] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.118793] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.118921] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.118921] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.119075] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.119155] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.119368] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.119474] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.119532] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.119678] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.119880] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.120020] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.120119] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.120174] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.120315] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.120781] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.120932] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c is going to be created. [ 769.177183] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.177354] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.177434] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.177655] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.177839] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.187761] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c in Status: IN_PROGRESS for 2s [ 769.259401] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fc0ae2a8-a235-4d05-9f57-5fec83d37151',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.275076] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.275076] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.275076] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.275076] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.275076] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.275076] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.275076] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.275076] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.275076] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.275076] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.275076] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e30e2153-2e8b-4b47-9977-1856fb2d6991 is going to be deleted. [ 769.276085] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.276085] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.276085] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.276085] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.276211] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.276369] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.276463] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.276515] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.276725] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.276809] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.276897] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc0ae2a8-a235-4d05-9f57-5fec83d37151 is going to be updated. [ 769.278084] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e30e2153-2e8b-4b47-9977-1856fb2d6991',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.279891] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.282803] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c2d79e00-b6b0-41f3-96fb-49ab2b10751b: rpc.has_security_group_logging(os_id): False [ 769.312786] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.313059] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.313184] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.313570] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.313705] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.313944] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.314153] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.314290] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.314564] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.314665] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.314905] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.315271] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.315361] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.315543] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.315707] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.315979] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.316137] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.316214] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.316443] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.316598] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.316775] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b is going to be updated. [ 769.329564] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.329564] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.329564] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.329564] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.329564] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.330598] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.330951] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.330951] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.331279] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.331339] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.331471] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e30e2153-2e8b-4b47-9977-1856fb2d6991" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.341908] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc0ae2a8-a235-4d05-9f57-5fec83d37151 in Status: IN_PROGRESS for 2s [ 769.388635] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.388835] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.388912] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.389133] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.389324] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.406798] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b in Status: IN_PROGRESS for 2s [ 769.768282] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fc0ae2a8-a235-4d05-9f57-5fec83d37151: rpc.has_security_group_logging(os_id): False [ 769.783328] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e30e2153-2e8b-4b47-9977-1856fb2d6991: rpc.has_security_group_logging(os_id): False [ 769.784471] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.787320] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.787491] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.787557] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.787775] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.787858] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.788201] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.788288] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.788288] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.788450] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.788536] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.788684] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc0ae2a8-a235-4d05-9f57-5fec83d37151 is going to be updated. [ 769.803489] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.803489] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.803718] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.803755] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.804895] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.804895] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.804895] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.804895] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.804895] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.804895] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.804895] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e30e2153-2e8b-4b47-9977-1856fb2d6991 is going to be created. [ 769.818294] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/e30e2153-2e8b-4b47-9977-1856fb2d6991], does not exist path=[/infra/domains/default/groups/e30e2153-2e8b-4b47-9977-1856fb2d6991]."\n}' [ 769.818453] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e30e2153-2e8b-4b47-9977-1856fb2d6991 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/e30e2153-2e8b-4b47-9977-1856fb2d6991 [ 769.818529] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 769.843205] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.843379] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.843426] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.843633] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.843750] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.847895] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.848085] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.848085] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.848278] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.849334] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.849593] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.849701] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.849754] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.849915] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.849983] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.851119] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.851119] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.851119] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.851119] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.851119] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.851119] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e30e2153-2e8b-4b47-9977-1856fb2d6991 is going to be created. [ 769.853876] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc0ae2a8-a235-4d05-9f57-5fec83d37151 in Status: IN_PROGRESS for 2s [ 769.866169] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/e30e2153-2e8b-4b47-9977-1856fb2d6991], does not exist path=[/infra/domains/default/groups/e30e2153-2e8b-4b47-9977-1856fb2d6991]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/e30e2153-2e8b-4b47-9977-1856fb2d6991 [ 769.866454] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e30e2153-2e8b-4b47-9977-1856fb2d6991" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.866899] env[70764]: Traceback (most recent call last): [ 769.866981] env[70764]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 769.866981] env[70764]: return func(*args, **kwargs) [ 769.866981] env[70764]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 769.866981] env[70764]: res.raise_for_status() [ 769.866981] env[70764]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 769.866981] env[70764]: raise HTTPError(http_error_msg, response=self) [ 769.866981] env[70764]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/e30e2153-2e8b-4b47-9977-1856fb2d6991 [ 769.866981] env[70764]: During handling of the above exception, another exception occurred: [ 769.866981] env[70764]: Traceback (most recent call last): [ 769.866981] env[70764]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 769.866981] env[70764]: listener.cb(fileno) [ 769.866981] env[70764]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 769.866981] env[70764]: result = function(*args, **kwargs) [ 769.866981] env[70764]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 769.866981] env[70764]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 769.866981] env[70764]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 769.866981] env[70764]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 769.866981] env[70764]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 769.866981] env[70764]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 769.866981] env[70764]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 769.866981] env[70764]: res.raise_for_status() [ 769.866981] env[70764]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 769.866981] env[70764]: raise HTTPError(http_error_msg, response=self) [ 769.866981] env[70764]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/e30e2153-2e8b-4b47-9977-1856fb2d6991 [ 769.866981] env[70764]: Removing descriptor: 13 [ 770.130162] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a793445b-22a7-4c79-b31c-1beebe657659 in Status: SUCCESS [ 770.130479] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.287102] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.287343] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.287429] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.287661] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.287782] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.287895] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b is going to be updated. [ 770.319416] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.319615] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.319615] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.319762] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.319908] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.329035] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b in Status: IN_PROGRESS for 2s [ 770.449518] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 770.449634] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=6 [ 771.214670] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c in Status: SUCCESS [ 771.215623] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.351880] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc0ae2a8-a235-4d05-9f57-5fec83d37151 in Status: SUCCESS [ 771.352141] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc0ae2a8-a235-4d05-9f57-5fec83d37151 deletion is rescheduled due to dependency. [ 771.352280] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc0ae2a8-a235-4d05-9f57-5fec83d37151" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.421379] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b in Status: SUCCESS [ 771.421561] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.421771] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.422043] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.422141] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.866135] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc0ae2a8-a235-4d05-9f57-5fec83d37151 in Status: SUCCESS [ 771.866405] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc0ae2a8-a235-4d05-9f57-5fec83d37151" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.925530] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.925779] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.339033] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b in Status: SUCCESS [ 772.339349] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.339464] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.339675] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.339868] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.339984] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.340141] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.340243] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.340323] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.340407] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.340498] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.842553] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.842731] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.842786] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.843052] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.843250] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.843380] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.843436] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.843574] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.843660] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.843747] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.843890] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.843982] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.844044] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.844186] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.844323] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.844413] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.844464] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.844600] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.844779] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.844779] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.844872] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.347944] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c2d79e00-b6b0-41f3-96fb-49ab2b10751b: rpc.has_security_group_logging(os_id): False [ 773.369032] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.369215] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.369296] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.369525] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.386573] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.387494] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.387494] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.387494] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.387774] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.387806] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.388120] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.388120] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.388275] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.388335] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.388375] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.388553] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.388649] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.388710] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.388854] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.388967] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.389216] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b is going to be updated. [ 773.441990] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.442168] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.442277] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.442638] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.442638] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.459100] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b in Status: IN_PROGRESS for 2s [ 775.450451] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 775.450782] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 775.475229] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b in Status: SUCCESS [ 775.475456] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.518270] env[70764]: INFO networking_nsxv3.common.synchronization [req-d9766d02-8318-43b7-a034-0162167acaa2 req-bc6773b2-4919-4c02-941d-eb1982c92ff3 tempest-TenantUsagesTestJSON-1579100380 tempest-TenantUsagesTestJSON-1579100380-project-member] Enqueued Resource ID: c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c with Priority: HIGHEST for action security_group_members [ 777.518270] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c with Priority: HIGHEST for action security_group_members [ 777.518545] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.518612] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.518650] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.518828] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.518982] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.520200] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.520200] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.520200] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.520200] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.520200] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.027171] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.027379] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.027379] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.027596] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.048621] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.048890] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.049045] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.049096] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.049287] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.049370] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.049459] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c is going to be updated. [ 778.075496] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.075693] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.075737] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.075908] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.076091] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.083844] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c in Status: IN_PROGRESS for 2s [ 780.095093] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c in Status: SUCCESS [ 780.095399] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c deletion is rescheduled due to dependency. [ 780.095399] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.519469] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 782.519772] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 784.086160] env[70764]: INFO networking_nsxv3.common.synchronization [req-8d3933ed-f00d-484d-8fd6-d2730d77c1b8 req-33b1b6e3-119f-4890-8891-3cd40eeb6f2b tempest-ServersAdminTestJSON-868847224 tempest-ServersAdminTestJSON-868847224-project-member] Enqueued Resource ID: 5e9c0048-237b-4cab-86e0-e56dce546daa with Priority: HIGHEST for action security_group_members [ 784.086160] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e9c0048-237b-4cab-86e0-e56dce546daa with Priority: HIGHEST for action security_group_members [ 784.086160] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e9c0048-237b-4cab-86e0-e56dce546daa taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.086160] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.086512] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.086512] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.086572] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.086623] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.086717] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.086961] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.087025] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.089792] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e9c0048-237b-4cab-86e0-e56dce546daa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.450149] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-442 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.450348] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-442" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.450470] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-442" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.450749] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-442" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.451031] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.451199] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.451312] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.451534] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.451668] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.451869] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 784.451981] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 784.452130] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 784.452244] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 784.452353] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 784.452453] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 784.452582] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 784.471312] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 784.471480] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 784.471683] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 784.471862] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-442" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.472419] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-b01297e0-0b62-415a-8526-f218934a81f0 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.472634] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-b01297e0-0b62-415a-8526-f218934a81f0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.472725] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-b01297e0-0b62-415a-8526-f218934a81f0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.473048] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-b01297e0-0b62-415a-8526-f218934a81f0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.473220] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b01297e0-0b62-415a-8526-f218934a81f0',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.589673] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e9c0048-237b-4cab-86e0-e56dce546daa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.976441] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.976779] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.976912] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.977399] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.977399] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.977494] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port b01297e0-0b62-415a-8526-f218934a81f0 not found, creating... [ 784.977767] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.978383] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.978383] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.978383] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.978503] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.978766] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.978920] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.979044] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.979255] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.979388] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.979524] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: b01297e0-0b62-415a-8526-f218934a81f0 is going to be created. [ 785.001035] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.001035] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.001400] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.001467] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.001850] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.001929] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-b01297e0-0b62-415a-8526-f218934a81f0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.092085] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e9c0048-237b-4cab-86e0-e56dce546daa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.594589] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.594833] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.594833] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.595056] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.595243] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.595395] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e9c0048-237b-4cab-86e0-e56dce546daa is going to be updated. [ 785.625189] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.625794] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.625794] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.625794] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.626036] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.634462] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e9c0048-237b-4cab-86e0-e56dce546daa in Status: IN_PROGRESS for 2s [ 785.731741] env[70764]: INFO networking_nsxv3.common.synchronization [req-8d3933ed-f00d-484d-8fd6-d2730d77c1b8 req-701baa5c-60c6-45ba-aef0-fcc7b2617f28 service nova] Enqueued Resource ID: 5e9c0048-237b-4cab-86e0-e56dce546daa with Priority: HIGHEST for action security_group_rules [ 785.731867] env[70764]: INFO networking_nsxv3.common.synchronization [req-8d3933ed-f00d-484d-8fd6-d2730d77c1b8 req-701baa5c-60c6-45ba-aef0-fcc7b2617f28 service nova] Enqueued Resource ID: 5e9c0048-237b-4cab-86e0-e56dce546daa with Priority: HIGHEST for action security_group_members [ 785.732047] env[70764]: INFO networking_nsxv3.common.synchronization [req-8d3933ed-f00d-484d-8fd6-d2730d77c1b8 req-701baa5c-60c6-45ba-aef0-fcc7b2617f28 service nova] Enqueued Resource ID: b01297e0-0b62-415a-8526-f218934a81f0 with Priority: HIGHEST for action port [ 785.732880] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e9c0048-237b-4cab-86e0-e56dce546daa with Priority: HIGHEST for action security_group_rules [ 785.732981] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e9c0048-237b-4cab-86e0-e56dce546daa with Priority: HIGHEST for action security_group_members [ 785.733028] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b01297e0-0b62-415a-8526-f218934a81f0 with Priority: HIGHEST for action port [ 785.733332] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e9c0048-237b-4cab-86e0-e56dce546daa taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.733539] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.733539] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.733858] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.733858] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e9c0048-237b-4cab-86e0-e56dce546daa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.734635] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e9c0048-237b-4cab-86e0-e56dce546daa taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.734737] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.734915] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-b01297e0-0b62-415a-8526-f218934a81f0 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.735141] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b01297e0-0b62-415a-8526-f218934a81f0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.735141] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b01297e0-0b62-415a-8526-f218934a81f0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.735319] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b01297e0-0b62-415a-8526-f218934a81f0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.735411] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b01297e0-0b62-415a-8526-f218934a81f0',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.237407] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e9c0048-237b-4cab-86e0-e56dce546daa taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.237807] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.237807] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b01297e0-0b62-415a-8526-f218934a81f0 with status ACTIVE [ 786.237807] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.238102] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.238102] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.238207] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.238347] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.238514] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.238606] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.238672] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.238790] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.239035] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.239182] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.239263] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.239316] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.243116] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.243116] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.243116] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b01297e0-0b62-415a-8526-f218934a81f0 is going to be updated. [ 786.269743] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.269993] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.269993] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.270184] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.270321] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.270496] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b01297e0-0b62-415a-8526-f218934a81f0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.495891] env[70764]: INFO networking_nsxv3.common.synchronization [req-21ffab92-510d-45fa-99fe-2e21c43799bc req-18ff23e1-214c-484d-a8db-8e7f0cd0c2ce tempest-ServersV294TestFqdnHostnames-288623823 tempest-ServersV294TestFqdnHostnames-288623823-project-member] Enqueued Resource ID: c0695687-32e8-4e4a-a8c8-31e6c3709596 with Priority: HIGHEST for action security_group_members [ 786.495891] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0695687-32e8-4e4a-a8c8-31e6c3709596 with Priority: HIGHEST for action security_group_members [ 786.495891] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0695687-32e8-4e4a-a8c8-31e6c3709596 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.496135] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0695687-32e8-4e4a-a8c8-31e6c3709596" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.496135] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0695687-32e8-4e4a-a8c8-31e6c3709596" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.496391] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0695687-32e8-4e4a-a8c8-31e6c3709596" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.496493] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.496865] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.496938] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.497302] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.497414] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.497537] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0695687-32e8-4e4a-a8c8-31e6c3709596',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.770462] env[70764]: INFO networking_nsxv3.common.synchronization [req-b48c1513-559a-453b-93bb-fd04c87cbbf0 req-fe627441-f2b7-4cc7-baf2-bdbd2a3a2c2e tempest-ServerRescueNegativeTestJSON-1208111124 tempest-ServerRescueNegativeTestJSON-1208111124-project-member] Enqueued Resource ID: 1f7d8ca5-61df-4ea2-b964-843e08d1b082 with Priority: HIGHEST for action security_group_members [ 786.771042] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f7d8ca5-61df-4ea2-b964-843e08d1b082 with Priority: HIGHEST for action security_group_members [ 786.775021] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f7d8ca5-61df-4ea2-b964-843e08d1b082 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.775021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.775021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.775021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.775021] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.775021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.775021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.775021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.775021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.775021] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f7d8ca5-61df-4ea2-b964-843e08d1b082',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.000469] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.000628] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.000711] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.000919] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.020259] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.020551] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.020645] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.020709] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.021596] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.021596] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.021596] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0695687-32e8-4e4a-a8c8-31e6c3709596 is going to be updated. [ 787.045711] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.045918] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.045967] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.046182] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.046324] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.056303] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0695687-32e8-4e4a-a8c8-31e6c3709596 in Status: IN_PROGRESS for 2s [ 787.267682] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-904 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.269328] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-904" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.269328] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-904" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.269328] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-904" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.269328] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.270298] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.270572] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.274229] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.274229] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.274229] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 787.274229] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 787.274229] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 787.274229] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 787.274229] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 787.274229] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 787.274229] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 787.278339] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.278339] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.278339] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.278339] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.278339] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.278575] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.278575] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.278667] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.279051] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.279051] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.279051] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f7d8ca5-61df-4ea2-b964-843e08d1b082 already deleted. [ 787.279051] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.295131] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 787.295131] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 787.295131] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 787.295131] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-904" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.295131] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-3c97b8c7-7d4e-46f8-a4e9-97ae19a9cfec taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.295131] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-3c97b8c7-7d4e-46f8-a4e9-97ae19a9cfec" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.295131] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-3c97b8c7-7d4e-46f8-a4e9-97ae19a9cfec" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.295131] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-3c97b8c7-7d4e-46f8-a4e9-97ae19a9cfec" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.295841] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c97b8c7-7d4e-46f8-a4e9-97ae19a9cfec',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.646488] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e9c0048-237b-4cab-86e0-e56dce546daa in Status: SUCCESS [ 787.646742] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.647056] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.647504] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.647504] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.647504] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.647504] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.647762] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.647762] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.647999] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e9c0048-237b-4cab-86e0-e56dce546daa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.799022] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.800049] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.800049] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.800049] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.800049] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.800049] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 3c97b8c7-7d4e-46f8-a4e9-97ae19a9cfec not found, creating... [ 787.800371] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.800481] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.800564] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.800724] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.800857] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.801246] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.801402] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.801527] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.801735] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.801866] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.802114] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 3c97b8c7-7d4e-46f8-a4e9-97ae19a9cfec is going to be created. [ 787.820705] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.820953] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.821721] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.821721] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.821848] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.822227] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-3c97b8c7-7d4e-46f8-a4e9-97ae19a9cfec" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.150679] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e9c0048-237b-4cab-86e0-e56dce546daa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.652605] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e9c0048-237b-4cab-86e0-e56dce546daa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.680018] env[70764]: INFO networking_nsxv3.common.synchronization [req-b48c1513-559a-453b-93bb-fd04c87cbbf0 req-835e14e8-d557-4635-beee-87865f400481 service nova] Enqueued Resource ID: 1f7d8ca5-61df-4ea2-b964-843e08d1b082 with Priority: HIGHEST for action security_group_rules [ 788.680214] env[70764]: INFO networking_nsxv3.common.synchronization [req-b48c1513-559a-453b-93bb-fd04c87cbbf0 req-835e14e8-d557-4635-beee-87865f400481 service nova] Enqueued Resource ID: 1f7d8ca5-61df-4ea2-b964-843e08d1b082 with Priority: HIGHEST for action security_group_members [ 788.680351] env[70764]: INFO networking_nsxv3.common.synchronization [req-b48c1513-559a-453b-93bb-fd04c87cbbf0 req-835e14e8-d557-4635-beee-87865f400481 service nova] Enqueued Resource ID: 3c97b8c7-7d4e-46f8-a4e9-97ae19a9cfec with Priority: HIGHEST for action port [ 788.680861] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f7d8ca5-61df-4ea2-b964-843e08d1b082 with Priority: HIGHEST for action security_group_rules [ 788.681082] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f7d8ca5-61df-4ea2-b964-843e08d1b082 with Priority: HIGHEST for action security_group_members [ 788.681237] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c97b8c7-7d4e-46f8-a4e9-97ae19a9cfec with Priority: HIGHEST for action port [ 788.682203] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f7d8ca5-61df-4ea2-b964-843e08d1b082 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.682203] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.682203] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.682203] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.686954] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f7d8ca5-61df-4ea2-b964-843e08d1b082',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.688337] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f7d8ca5-61df-4ea2-b964-843e08d1b082 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.688718] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.688718] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.688718] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.688886] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.689468] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.689468] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.689468] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.689468] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.689468] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f7d8ca5-61df-4ea2-b964-843e08d1b082',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.691769] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c97b8c7-7d4e-46f8-a4e9-97ae19a9cfec taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.691879] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c97b8c7-7d4e-46f8-a4e9-97ae19a9cfec" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.691996] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c97b8c7-7d4e-46f8-a4e9-97ae19a9cfec" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.693496] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c97b8c7-7d4e-46f8-a4e9-97ae19a9cfec" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.693595] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c97b8c7-7d4e-46f8-a4e9-97ae19a9cfec',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.066059] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0695687-32e8-4e4a-a8c8-31e6c3709596 in Status: SUCCESS [ 789.066254] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0695687-32e8-4e4a-a8c8-31e6c3709596 deletion is rescheduled due to dependency. [ 789.066340] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0695687-32e8-4e4a-a8c8-31e6c3709596" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.155521] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.155732] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.155811] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.156093] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.156317] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.156317] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e9c0048-237b-4cab-86e0-e56dce546daa is going to be updated. [ 789.186144] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.186144] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.186144] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.186144] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.186144] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.196145] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f7d8ca5-61df-4ea2-b964-843e08d1b082 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.196334] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.196643] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f7d8ca5-61df-4ea2-b964-843e08d1b082',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.197808] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3c97b8c7-7d4e-46f8-a4e9-97ae19a9cfec with status ACTIVE [ 789.198117] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.198314] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.198412] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.198689] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.199260] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.199370] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.199489] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.199595] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.199842] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.199949] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.200175] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.200710] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.200710] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.200710] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.200710] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.200838] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3c97b8c7-7d4e-46f8-a4e9-97ae19a9cfec is going to be updated. [ 789.202683] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e9c0048-237b-4cab-86e0-e56dce546daa in Status: IN_PROGRESS for 2s [ 789.241092] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.241092] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.241092] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.241360] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.241515] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.241720] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c97b8c7-7d4e-46f8-a4e9-97ae19a9cfec" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.704318] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f7d8ca5-61df-4ea2-b964-843e08d1b082',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.817909] env[70764]: INFO networking_nsxv3.common.synchronization [None req-5db45f47-767a-4d85-bfeb-39c64588a90b tempest-MigrationsAdminTest-1035321564 tempest-MigrationsAdminTest-1035321564-project-member] Enqueued Resource ID: 6600b588-7e61-48d9-bc88-e4a37a077ea5 with Priority: HIGHEST for action security_group_rules [ 789.817909] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6600b588-7e61-48d9-bc88-e4a37a077ea5 with Priority: HIGHEST for action security_group_rules [ 789.817909] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6600b588-7e61-48d9-bc88-e4a37a077ea5 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.817909] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6600b588-7e61-48d9-bc88-e4a37a077ea5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.817909] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6600b588-7e61-48d9-bc88-e4a37a077ea5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.817909] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6600b588-7e61-48d9-bc88-e4a37a077ea5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.817909] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6600b588-7e61-48d9-bc88-e4a37a077ea5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.933144] env[70764]: INFO networking_nsxv3.common.synchronization [None req-c8325286-249e-4db8-9cdb-4bc95894613e tempest-MigrationsAdminTest-1035321564 tempest-MigrationsAdminTest-1035321564-project-member] Enqueued Resource ID: 6600b588-7e61-48d9-bc88-e4a37a077ea5 with Priority: HIGHEST for action security_group_rules [ 789.933796] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6600b588-7e61-48d9-bc88-e4a37a077ea5 with Priority: HIGHEST for action security_group_rules [ 789.934530] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6600b588-7e61-48d9-bc88-e4a37a077ea5 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.934530] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6600b588-7e61-48d9-bc88-e4a37a077ea5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.208147] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.208354] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.208434] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.208637] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.208740] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.208848] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f7d8ca5-61df-4ea2-b964-843e08d1b082 is going to be created. [ 790.237535] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.237732] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.237732] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.237975] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.238168] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.253370] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f7d8ca5-61df-4ea2-b964-843e08d1b082 in Status: UNINITIALIZED for 2s [ 790.336773] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.336970] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.336970] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.337266] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.337378] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.337488] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6600b588-7e61-48d9-bc88-e4a37a077ea5 already deleted. [ 790.337591] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6600b588-7e61-48d9-bc88-e4a37a077ea5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.337749] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6600b588-7e61-48d9-bc88-e4a37a077ea5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.337969] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6600b588-7e61-48d9-bc88-e4a37a077ea5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.338065] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6600b588-7e61-48d9-bc88-e4a37a077ea5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.860887] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.861259] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.861259] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.861416] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.861504] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.861616] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6600b588-7e61-48d9-bc88-e4a37a077ea5 already deleted. [ 790.861698] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6600b588-7e61-48d9-bc88-e4a37a077ea5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.214253] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e9c0048-237b-4cab-86e0-e56dce546daa in Status: SUCCESS [ 791.214253] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.214253] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.214253] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.214253] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.214253] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.214253] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.214253] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.214253] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.214253] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.214253] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e9c0048-237b-4cab-86e0-e56dce546daa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.717301] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e9c0048-237b-4cab-86e0-e56dce546daa taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.717301] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.717480] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.717849] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.718025] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.718150] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.718218] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.718426] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.718547] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.718675] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.718923] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e9c0048-237b-4cab-86e0-e56dce546daa taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.719022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.719063] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.719200] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.719342] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.719446] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.719514] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.719656] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.719736] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.719818] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.719908] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e9c0048-237b-4cab-86e0-e56dce546daa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.056176] env[70764]: INFO networking_nsxv3.common.synchronization [req-4493a7c3-e5a1-4588-8c1b-4a5ba1ebe72e req-5e325b09-fdb4-4360-bf8c-11ecdc459f2c tempest-ServerRescueNegativeTestJSON-1208111124 tempest-ServerRescueNegativeTestJSON-1208111124-project-member] Enqueued Resource ID: 1f7d8ca5-61df-4ea2-b964-843e08d1b082 with Priority: HIGHEST for action security_group_members [ 792.056504] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f7d8ca5-61df-4ea2-b964-843e08d1b082 with Priority: HIGHEST for action security_group_members [ 792.056805] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f7d8ca5-61df-4ea2-b964-843e08d1b082 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.056911] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.223074] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e9c0048-237b-4cab-86e0-e56dce546daa: rpc.has_security_group_logging(os_id): False [ 792.247848] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.248117] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.248296] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.248589] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.263682] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f7d8ca5-61df-4ea2-b964-843e08d1b082 in Status: SUCCESS [ 792.263682] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.263682] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.264082] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.264082] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.264190] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.264282] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.264402] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.265167] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.265167] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.265167] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1f7d8ca5-61df-4ea2-b964-843e08d1b082',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.265561] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.265945] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.266195] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.266876] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.266876] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.266876] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.266876] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.266876] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f7d8ca5-61df-4ea2-b964-843e08d1b082',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.275422] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.275755] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.278389] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.278389] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.278389] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.278389] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.278389] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.278389] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.278389] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.278389] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.278389] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.278389] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.278389] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.278389] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.278389] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.278389] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.278389] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e9c0048-237b-4cab-86e0-e56dce546daa is going to be updated. [ 792.372789] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.372967] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.373039] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.373244] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.373432] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.389913] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e9c0048-237b-4cab-86e0-e56dce546daa in Status: IN_PROGRESS for 2s [ 792.433718] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-904 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.433936] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-904" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.434072] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-904" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.435409] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-904" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.435409] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.435409] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.435409] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.435409] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.435409] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.435861] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 792.435861] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 792.435861] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 792.435973] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 792.436048] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 792.436586] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 792.436586] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 792.462873] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 792.463092] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 792.463260] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 792.463512] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-904" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.463921] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-9e91c472-2431-4af9-9f07-2ad3b4c662ef taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.464250] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-9e91c472-2431-4af9-9f07-2ad3b4c662ef" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.464395] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-9e91c472-2431-4af9-9f07-2ad3b4c662ef" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.464715] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-9e91c472-2431-4af9-9f07-2ad3b4c662ef" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.464852] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e91c472-2431-4af9-9f07-2ad3b4c662ef',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.769717] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f7d8ca5-61df-4ea2-b964-843e08d1b082 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.769919] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.770105] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f7d8ca5-61df-4ea2-b964-843e08d1b082',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.967959] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.968210] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.968338] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.968625] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.968776] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.968925] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 9e91c472-2431-4af9-9f07-2ad3b4c662ef not found, creating... [ 792.969425] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.969542] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.969665] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.969882] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.970033] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.970401] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.970565] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.970681] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.970885] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.971109] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.971247] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 9e91c472-2431-4af9-9f07-2ad3b4c662ef is going to be created. [ 792.992078] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.992321] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.992450] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.992735] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.993191] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.993301] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-9e91c472-2431-4af9-9f07-2ad3b4c662ef" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.272280] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f7d8ca5-61df-4ea2-b964-843e08d1b082',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.678693] env[70764]: INFO networking_nsxv3.common.synchronization [req-4493a7c3-e5a1-4588-8c1b-4a5ba1ebe72e req-f6ee2f78-de20-4449-8e5a-3b99ff898428 service nova] Enqueued Resource ID: 1f7d8ca5-61df-4ea2-b964-843e08d1b082 with Priority: HIGHEST for action security_group_rules [ 793.678878] env[70764]: INFO networking_nsxv3.common.synchronization [req-4493a7c3-e5a1-4588-8c1b-4a5ba1ebe72e req-f6ee2f78-de20-4449-8e5a-3b99ff898428 service nova] Enqueued Resource ID: 1f7d8ca5-61df-4ea2-b964-843e08d1b082 with Priority: HIGHEST for action security_group_members [ 793.679031] env[70764]: INFO networking_nsxv3.common.synchronization [req-4493a7c3-e5a1-4588-8c1b-4a5ba1ebe72e req-f6ee2f78-de20-4449-8e5a-3b99ff898428 service nova] Enqueued Resource ID: 9e91c472-2431-4af9-9f07-2ad3b4c662ef with Priority: HIGHEST for action port [ 793.679288] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f7d8ca5-61df-4ea2-b964-843e08d1b082 with Priority: HIGHEST for action security_group_rules [ 793.679413] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f7d8ca5-61df-4ea2-b964-843e08d1b082 with Priority: HIGHEST for action security_group_members [ 793.679509] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e91c472-2431-4af9-9f07-2ad3b4c662ef with Priority: HIGHEST for action port [ 793.680416] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f7d8ca5-61df-4ea2-b964-843e08d1b082 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.680416] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.680416] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f7d8ca5-61df-4ea2-b964-843e08d1b082 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.680534] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.680749] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e91c472-2431-4af9-9f07-2ad3b4c662ef taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.680859] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e91c472-2431-4af9-9f07-2ad3b4c662ef" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.680859] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e91c472-2431-4af9-9f07-2ad3b4c662ef" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.681076] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e91c472-2431-4af9-9f07-2ad3b4c662ef" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.681164] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e91c472-2431-4af9-9f07-2ad3b4c662ef',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.774836] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.775030] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.775171] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.775440] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.775604] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.775749] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f7d8ca5-61df-4ea2-b964-843e08d1b082 is going to be updated. [ 793.803008] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.803258] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.803356] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.803633] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.803789] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.813203] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f7d8ca5-61df-4ea2-b964-843e08d1b082 in Status: IN_PROGRESS for 2s [ 794.185070] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9e91c472-2431-4af9-9f07-2ad3b4c662ef with status ACTIVE [ 794.185070] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.185070] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.185070] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.185070] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.185070] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.185070] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.185070] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.185070] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.185070] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.185070] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.185070] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.185070] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.185070] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.185070] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.185070] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.185669] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9e91c472-2431-4af9-9f07-2ad3b4c662ef is going to be updated. [ 794.218471] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.218717] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.218868] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.219219] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.219465] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.219740] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e91c472-2431-4af9-9f07-2ad3b4c662ef" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.406098] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e9c0048-237b-4cab-86e0-e56dce546daa in Status: SUCCESS [ 794.406098] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.579020] env[70764]: INFO networking_nsxv3.common.synchronization [None req-5fd5ff92-5843-4613-82fd-a66541c80649 tempest-AttachVolumeNegativeTest-232785497 tempest-AttachVolumeNegativeTest-232785497-project-member] Enqueued Resource ID: 0e0a8aca-d575-4597-b049-0d3d263dac47 with Priority: HIGHEST for action security_group_rules [ 794.579020] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e0a8aca-d575-4597-b049-0d3d263dac47 with Priority: HIGHEST for action security_group_rules [ 794.579020] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e0a8aca-d575-4597-b049-0d3d263dac47 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.579020] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e0a8aca-d575-4597-b049-0d3d263dac47" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.579020] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e0a8aca-d575-4597-b049-0d3d263dac47" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.579020] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e0a8aca-d575-4597-b049-0d3d263dac47" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.579020] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e0a8aca-d575-4597-b049-0d3d263dac47',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.706042] env[70764]: INFO networking_nsxv3.common.synchronization [None req-af7fa4b1-7a4e-41d2-90c7-557d6808acae tempest-AttachVolumeNegativeTest-232785497 tempest-AttachVolumeNegativeTest-232785497-project-member] Enqueued Resource ID: 0e0a8aca-d575-4597-b049-0d3d263dac47 with Priority: HIGHEST for action security_group_rules [ 794.706583] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e0a8aca-d575-4597-b049-0d3d263dac47 with Priority: HIGHEST for action security_group_rules [ 794.706862] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e0a8aca-d575-4597-b049-0d3d263dac47 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.706969] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e0a8aca-d575-4597-b049-0d3d263dac47" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.751723] env[70764]: INFO networking_nsxv3.common.synchronization [req-e37a9351-567a-40aa-b9c1-5c66c4b0cb05 req-8c7a95f8-a4bd-4b16-be24-8c2523197921 tempest-ImagesOneServerNegativeTestJSON-1318507346 tempest-ImagesOneServerNegativeTestJSON-1318507346-project-member] Enqueued Resource ID: 2a93825c-656b-4f3f-b946-3346edd746bf with Priority: HIGHEST for action security_group_members [ 794.752572] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a93825c-656b-4f3f-b946-3346edd746bf with Priority: HIGHEST for action security_group_members [ 794.752572] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a93825c-656b-4f3f-b946-3346edd746bf taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.752702] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.752746] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.752920] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.756590] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.756718] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.756783] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.756958] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.757793] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.757793] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a93825c-656b-4f3f-b946-3346edd746bf',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.098899] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.099071] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.099157] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.099377] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.099470] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.099566] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e0a8aca-d575-4597-b049-0d3d263dac47 already deleted. [ 795.099648] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e0a8aca-d575-4597-b049-0d3d263dac47" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.099794] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e0a8aca-d575-4597-b049-0d3d263dac47" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.099945] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e0a8aca-d575-4597-b049-0d3d263dac47" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.100040] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e0a8aca-d575-4597-b049-0d3d263dac47',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.261100] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.261382] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.261382] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.261721] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.300819] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-340 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.301120] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-340" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.301416] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-340" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.301464] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-340" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.301845] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.301845] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.301984] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.306383] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.306575] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.306838] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 795.307073] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 795.307221] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 795.307393] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 795.307504] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 795.307611] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 795.307744] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 795.310833] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.311288] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.311397] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.311490] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.311636] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.311719] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.313076] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a93825c-656b-4f3f-b946-3346edd746bf is going to be updated. [ 795.329796] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 795.329796] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 795.329796] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 795.329796] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-340" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.334570] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-5910fce4-566d-4370-9272-3646dd5a9543 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.334570] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-5910fce4-566d-4370-9272-3646dd5a9543" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.334570] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-5910fce4-566d-4370-9272-3646dd5a9543" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.334570] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-5910fce4-566d-4370-9272-3646dd5a9543" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.334570] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5910fce4-566d-4370-9272-3646dd5a9543',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.336210] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.336406] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.336406] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.336652] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.336783] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.349304] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a93825c-656b-4f3f-b946-3346edd746bf in Status: IN_PROGRESS for 2s [ 795.621518] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.621897] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.621897] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.622221] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.622221] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.622221] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e0a8aca-d575-4597-b049-0d3d263dac47 already deleted. [ 795.622348] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e0a8aca-d575-4597-b049-0d3d263dac47" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.824288] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f7d8ca5-61df-4ea2-b964-843e08d1b082 in Status: SUCCESS [ 795.824536] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.824698] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.824905] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.825175] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.825262] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.825348] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.825564] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.825672] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.825783] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.825963] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f7d8ca5-61df-4ea2-b964-843e08d1b082 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.826070] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.826121] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.826268] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.826427] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.826519] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.826578] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.826734] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.826805] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.826896] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.826984] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1f7d8ca5-61df-4ea2-b964-843e08d1b082',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.830111] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.830111] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.830111] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.830111] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.830111] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.830111] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.830111] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.830111] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f7d8ca5-61df-4ea2-b964-843e08d1b082',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.839773] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.840038] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.840182] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.840465] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.840635] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.840842] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 5910fce4-566d-4370-9272-3646dd5a9543 not found, creating... [ 795.841216] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.841410] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.841530] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.841762] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.842438] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.842846] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.843137] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.843300] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.843610] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.843775] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.843919] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 5910fce4-566d-4370-9272-3646dd5a9543 is going to be created. [ 795.862230] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.862551] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.862726] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.863043] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.864198] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.864611] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-5910fce4-566d-4370-9272-3646dd5a9543" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.331434] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1f7d8ca5-61df-4ea2-b964-843e08d1b082: rpc.has_security_group_logging(os_id): False [ 796.332741] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f7d8ca5-61df-4ea2-b964-843e08d1b082',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.349947] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.349947] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.349947] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.350194] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.350194] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.350343] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.350411] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.350454] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.351454] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.351454] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.351454] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.351454] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.351454] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.351454] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.351454] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.351454] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.351865] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.351865] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.351865] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.351865] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.351865] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f7d8ca5-61df-4ea2-b964-843e08d1b082 is going to be created. [ 796.403048] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.403048] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.403048] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.403319] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.403383] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.415430] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f7d8ca5-61df-4ea2-b964-843e08d1b082 in Status: IN_PROGRESS for 2s [ 796.581435] env[70764]: INFO networking_nsxv3.common.synchronization [req-e37a9351-567a-40aa-b9c1-5c66c4b0cb05 req-6f44cb8d-0507-4f95-a18a-8a68dcd864be service nova] Enqueued Resource ID: 2a93825c-656b-4f3f-b946-3346edd746bf with Priority: HIGHEST for action security_group_rules [ 796.581601] env[70764]: INFO networking_nsxv3.common.synchronization [req-e37a9351-567a-40aa-b9c1-5c66c4b0cb05 req-6f44cb8d-0507-4f95-a18a-8a68dcd864be service nova] Enqueued Resource ID: 2a93825c-656b-4f3f-b946-3346edd746bf with Priority: HIGHEST for action security_group_members [ 796.581734] env[70764]: INFO networking_nsxv3.common.synchronization [req-e37a9351-567a-40aa-b9c1-5c66c4b0cb05 req-6f44cb8d-0507-4f95-a18a-8a68dcd864be service nova] Enqueued Resource ID: 5910fce4-566d-4370-9272-3646dd5a9543 with Priority: HIGHEST for action port [ 796.585251] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a93825c-656b-4f3f-b946-3346edd746bf with Priority: HIGHEST for action security_group_rules [ 796.585251] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a93825c-656b-4f3f-b946-3346edd746bf with Priority: HIGHEST for action security_group_members [ 796.585251] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5910fce4-566d-4370-9272-3646dd5a9543 with Priority: HIGHEST for action port [ 796.585251] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a93825c-656b-4f3f-b946-3346edd746bf taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.585251] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.585251] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.585251] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.585251] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a93825c-656b-4f3f-b946-3346edd746bf',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.585251] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a93825c-656b-4f3f-b946-3346edd746bf taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.585251] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.585677] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-5910fce4-566d-4370-9272-3646dd5a9543 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.585677] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5910fce4-566d-4370-9272-3646dd5a9543" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.585677] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5910fce4-566d-4370-9272-3646dd5a9543" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.585793] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5910fce4-566d-4370-9272-3646dd5a9543" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.585793] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5910fce4-566d-4370-9272-3646dd5a9543',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.836444] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f7d8ca5-61df-4ea2-b964-843e08d1b082',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.088164] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a93825c-656b-4f3f-b946-3346edd746bf taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.088334] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.088565] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5910fce4-566d-4370-9272-3646dd5a9543 with status ACTIVE [ 797.088812] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.088924] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.088998] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.089213] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.089303] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.089803] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.090073] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.090073] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.090157] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.090246] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.091031] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.091031] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.091031] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.091031] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.091246] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.091246] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5910fce4-566d-4370-9272-3646dd5a9543 is going to be updated. [ 797.111327] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.111543] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.111617] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.111820] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.112215] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.112215] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5910fce4-566d-4370-9272-3646dd5a9543" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.342770] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.342983] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.343103] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.343433] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.343527] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.343586] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f7d8ca5-61df-4ea2-b964-843e08d1b082 is going to be updated. [ 797.361421] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a93825c-656b-4f3f-b946-3346edd746bf in Status: SUCCESS [ 797.361567] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a93825c-656b-4f3f-b946-3346edd746bf deletion is rescheduled due to dependency. [ 797.361687] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.361855] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.362208] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.362512] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.362685] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.362768] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.362950] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.363101] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.363161] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a93825c-656b-4f3f-b946-3346edd746bf',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.392822] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.393125] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.393269] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.393531] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.393704] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.407785] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f7d8ca5-61df-4ea2-b964-843e08d1b082 in Status: IN_PROGRESS for 2s [ 797.640471] env[70764]: INFO networking_nsxv3.common.synchronization [req-5878e4f6-f8e2-46c9-86b4-0e29d040a336 req-e022146b-6a9e-4ea3-8ebe-53899b3ae269 tempest-ServersNegativeTestMultiTenantJSON-2110591191 tempest-ServersNegativeTestMultiTenantJSON-2110591191-project-member] Enqueued Resource ID: 7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3 with Priority: HIGHEST for action security_group_members [ 797.641116] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3 with Priority: HIGHEST for action security_group_members [ 797.641430] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.641556] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.641618] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.641954] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.642693] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.642800] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.642880] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.643090] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.643185] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.643283] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.867935] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a93825c-656b-4f3f-b946-3346edd746bf',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.151490] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.151490] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.151490] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.151490] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.151490] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.151490] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.151490] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.151490] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.151490] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.151490] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.151490] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3 already deleted. [ 798.151912] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.198575] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-203 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.198818] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-203" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.198944] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-203" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.199358] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-203" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.199706] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.199878] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.199996] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.200258] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.200445] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.200646] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 798.200759] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 798.200867] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 798.200973] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 798.201158] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 798.201294] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 798.201433] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 798.220149] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 798.220324] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 798.220461] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 798.220639] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-203" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.220949] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-6b5507a2-c819-47f6-a108-658129d6ea1d taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.221169] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-6b5507a2-c819-47f6-a108-658129d6ea1d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.221306] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-6b5507a2-c819-47f6-a108-658129d6ea1d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.221624] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-6b5507a2-c819-47f6-a108-658129d6ea1d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.221776] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b5507a2-c819-47f6-a108-658129d6ea1d',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.370832] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a93825c-656b-4f3f-b946-3346edd746bf',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.428513] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f7d8ca5-61df-4ea2-b964-843e08d1b082 in Status: SUCCESS [ 798.429928] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.429928] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.429928] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.429928] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f7d8ca5-61df-4ea2-b964-843e08d1b082',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.653629] env[70764]: INFO networking_nsxv3.common.synchronization [req-b6f74308-47f4-4abc-ada7-d271c313f0a9 req-6b0f194c-ae1d-429c-adf3-6186877bdcb1 tempest-ImagesOneServerTestJSON-393500790 tempest-ImagesOneServerTestJSON-393500790-project-member] Enqueued Resource ID: bb6f4eb6-36d0-4604-a204-4c47b22b4b54 with Priority: HIGHEST for action security_group_members [ 798.653726] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb6f4eb6-36d0-4604-a204-4c47b22b4b54 with Priority: HIGHEST for action security_group_members [ 798.654309] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb6f4eb6-36d0-4604-a204-4c47b22b4b54 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.654309] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb6f4eb6-36d0-4604-a204-4c47b22b4b54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.654309] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb6f4eb6-36d0-4604-a204-4c47b22b4b54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.654481] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb6f4eb6-36d0-4604-a204-4c47b22b4b54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.654521] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.654621] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.654677] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.654820] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.654905] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.655433] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb6f4eb6-36d0-4604-a204-4c47b22b4b54',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.723790] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.723968] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.724110] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.724386] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.724530] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.724684] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 6b5507a2-c819-47f6-a108-658129d6ea1d not found, creating... [ 798.724942] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.725110] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.725235] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.725451] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.725583] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.725870] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.726034] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.726151] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.726353] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.726482] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.726616] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 6b5507a2-c819-47f6-a108-658129d6ea1d is going to be created. [ 798.745400] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.745631] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.745715] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.745946] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.746183] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.746427] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-6b5507a2-c819-47f6-a108-658129d6ea1d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.873266] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.873614] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.873614] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.873788] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.873875] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.873972] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a93825c-656b-4f3f-b946-3346edd746bf is going to be updated. [ 798.910724] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.910724] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.910724] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.912030] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.912030] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.921603] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a93825c-656b-4f3f-b946-3346edd746bf in Status: IN_PROGRESS for 2s [ 798.932031] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f7d8ca5-61df-4ea2-b964-843e08d1b082 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.932199] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.157011] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.158093] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.158093] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.158093] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.181035] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.181035] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.181404] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.181527] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.182199] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.182356] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.182612] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb6f4eb6-36d0-4604-a204-4c47b22b4b54 is going to be updated. [ 799.238405] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.238561] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.238620] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.238829] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.239018] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.248891] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb6f4eb6-36d0-4604-a204-4c47b22b4b54 in Status: IN_PROGRESS for 2s [ 799.418698] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f7d8ca5-61df-4ea2-b964-843e08d1b082 in Status: SUCCESS [ 799.418698] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.418698] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.418698] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.418698] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.418698] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.418698] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.418698] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.418698] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.418698] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.418698] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1f7d8ca5-61df-4ea2-b964-843e08d1b082',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.581357] env[70764]: INFO networking_nsxv3.common.synchronization [req-5878e4f6-f8e2-46c9-86b4-0e29d040a336 req-31bdd915-9f06-4715-842a-df755b0fdf3d service nova] Enqueued Resource ID: 7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3 with Priority: HIGHEST for action security_group_rules [ 799.581525] env[70764]: INFO networking_nsxv3.common.synchronization [req-5878e4f6-f8e2-46c9-86b4-0e29d040a336 req-31bdd915-9f06-4715-842a-df755b0fdf3d service nova] Enqueued Resource ID: 7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3 with Priority: HIGHEST for action security_group_members [ 799.581667] env[70764]: INFO networking_nsxv3.common.synchronization [req-5878e4f6-f8e2-46c9-86b4-0e29d040a336 req-31bdd915-9f06-4715-842a-df755b0fdf3d service nova] Enqueued Resource ID: 6b5507a2-c819-47f6-a108-658129d6ea1d with Priority: HIGHEST for action port [ 799.582271] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3 with Priority: HIGHEST for action security_group_rules [ 799.582443] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3 with Priority: HIGHEST for action security_group_members [ 799.582571] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b5507a2-c819-47f6-a108-658129d6ea1d with Priority: HIGHEST for action port [ 799.582901] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.583080] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.583179] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.583476] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.583599] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.584581] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.584701] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.584797] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.585113] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.585291] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.585371] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.585460] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.585605] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.585722] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.585842] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.586735] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b5507a2-c819-47f6-a108-658129d6ea1d taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.586810] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b5507a2-c819-47f6-a108-658129d6ea1d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.586896] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b5507a2-c819-47f6-a108-658129d6ea1d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.587066] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b5507a2-c819-47f6-a108-658129d6ea1d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.587981] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b5507a2-c819-47f6-a108-658129d6ea1d',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.920650] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f7d8ca5-61df-4ea2-b964-843e08d1b082 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.921143] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.921143] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.921143] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.921278] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.921393] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.921459] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.921614] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.921703] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.921790] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.921937] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f7d8ca5-61df-4ea2-b964-843e08d1b082 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.922049] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.922128] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.922338] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.922481] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.922579] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.922635] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.922767] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.922842] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.922923] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.923029] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1f7d8ca5-61df-4ea2-b964-843e08d1b082',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.089741] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.089741] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.089741] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.092211] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6b5507a2-c819-47f6-a108-658129d6ea1d with status ACTIVE [ 800.092211] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.092211] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.092211] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.092516] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.092516] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.092648] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.092725] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.092853] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.092901] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.092979] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.093173] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.093396] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.093396] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.093560] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.093560] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.093671] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6b5507a2-c819-47f6-a108-658129d6ea1d is going to be updated. [ 800.114173] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.114173] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.114173] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.114376] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.114474] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.114636] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b5507a2-c819-47f6-a108-658129d6ea1d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.425664] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1f7d8ca5-61df-4ea2-b964-843e08d1b082: rpc.has_security_group_logging(os_id): False [ 800.440870] env[70764]: INFO networking_nsxv3.common.synchronization [req-6d360499-f1ee-496a-ba6f-bae8e75c9724 req-9cb59145-69ad-4806-ac78-cfcfb04d1d5f tempest-ServersTestFqdnHostnames-964324386 tempest-ServersTestFqdnHostnames-964324386-project-member] Enqueued Resource ID: b221064c-6962-44ea-989e-cf4546ea92ab with Priority: HIGHEST for action security_group_members [ 800.445023] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b221064c-6962-44ea-989e-cf4546ea92ab with Priority: HIGHEST for action security_group_members [ 800.445023] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.445023] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.445023] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.445023] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.445023] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.445023] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.445023] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.445023] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.445023] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.445023] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.445023] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.445023] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.445023] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.445023] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.446019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.446019] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.446019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.446019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.446019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.446019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.446019] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f7d8ca5-61df-4ea2-b964-843e08d1b082 is going to be updated. [ 800.446244] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-b221064c-6962-44ea-989e-cf4546ea92ab taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.446244] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b221064c-6962-44ea-989e-cf4546ea92ab" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.446332] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b221064c-6962-44ea-989e-cf4546ea92ab" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.446502] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b221064c-6962-44ea-989e-cf4546ea92ab" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.447076] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.447174] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.447237] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.447381] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.447453] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.447543] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b221064c-6962-44ea-989e-cf4546ea92ab',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.506023] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.506184] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.506254] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.506463] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.506599] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.519775] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f7d8ca5-61df-4ea2-b964-843e08d1b082 in Status: IN_PROGRESS for 2s [ 800.593469] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.932188] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a93825c-656b-4f3f-b946-3346edd746bf in Status: SUCCESS [ 800.932188] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.932599] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.933191] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.934127] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.934314] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.934931] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.935953] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.935953] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.935953] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.937043] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2a93825c-656b-4f3f-b946-3346edd746bf',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.950272] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.950472] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.950548] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.950773] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.950862] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.951165] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.951293] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.951371] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.951543] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.951624] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.951740] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b221064c-6962-44ea-989e-cf4546ea92ab already deleted. [ 800.951851] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b221064c-6962-44ea-989e-cf4546ea92ab" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.096790] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.096949] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.097034] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.097278] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.097386] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.097488] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3 is going to be created. [ 801.121255] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.121403] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.121477] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.121685] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.121842] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.132527] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3 in Status: UNINITIALIZED for 2s [ 801.260254] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb6f4eb6-36d0-4604-a204-4c47b22b4b54 in Status: SUCCESS [ 801.260564] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb6f4eb6-36d0-4604-a204-4c47b22b4b54 deletion is rescheduled due to dependency. [ 801.260728] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb6f4eb6-36d0-4604-a204-4c47b22b4b54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.343602] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-676 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.343800] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-676" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.343948] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-676" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.344320] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-676" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.344580] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.344740] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.344858] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.345188] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.345256] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.345436] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 801.345547] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 801.345650] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 801.345753] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 801.345858] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 801.345959] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 801.346101] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 801.363479] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 801.363636] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 801.363772] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 801.363934] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-676" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.364278] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-354f32d5-8e58-4808-9fe7-c3c2581f19b2 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.364455] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-354f32d5-8e58-4808-9fe7-c3c2581f19b2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.364571] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-354f32d5-8e58-4808-9fe7-c3c2581f19b2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.364860] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-354f32d5-8e58-4808-9fe7-c3c2581f19b2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.364995] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('354f32d5-8e58-4808-9fe7-c3c2581f19b2',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.440909] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a93825c-656b-4f3f-b946-3346edd746bf taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.441149] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.441149] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.441335] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.441512] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.441622] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.441688] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.441837] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.441927] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.442027] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.443120] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a93825c-656b-4f3f-b946-3346edd746bf taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.443237] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.443297] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.443454] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.443601] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.443693] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.443752] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.443892] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.443973] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.444072] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.444166] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2a93825c-656b-4f3f-b946-3346edd746bf',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.867180] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.868359] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.868359] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.868359] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.868359] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.868359] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 354f32d5-8e58-4808-9fe7-c3c2581f19b2 not found, creating... [ 801.868711] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.868711] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.871912] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.871912] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.871912] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.871912] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.871912] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.871912] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.871912] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.871912] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.871912] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 354f32d5-8e58-4808-9fe7-c3c2581f19b2 is going to be created. [ 801.891443] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.891644] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.891764] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.892038] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.892290] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.892509] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-354f32d5-8e58-4808-9fe7-c3c2581f19b2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.946995] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2a93825c-656b-4f3f-b946-3346edd746bf: rpc.has_security_group_logging(os_id): False [ 801.971315] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.971402] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.971444] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.971640] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.971793] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.971913] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.972019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.972086] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.972292] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.972380] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.973018] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.973018] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.973018] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.973018] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.973018] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.973257] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.973257] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.973257] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.973388] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.973955] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.973955] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a93825c-656b-4f3f-b946-3346edd746bf is going to be updated. [ 802.039840] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.040020] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.040087] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.043867] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.044075] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.058175] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a93825c-656b-4f3f-b946-3346edd746bf in Status: IN_PROGRESS for 2s [ 802.532900] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f7d8ca5-61df-4ea2-b964-843e08d1b082 in Status: SUCCESS [ 802.533139] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.804401] env[70764]: INFO networking_nsxv3.common.synchronization [req-6d360499-f1ee-496a-ba6f-bae8e75c9724 req-24342d33-d817-4668-854f-d0c2cd1e1ad5 service nova] Enqueued Resource ID: b221064c-6962-44ea-989e-cf4546ea92ab with Priority: HIGHEST for action security_group_rules [ 802.804573] env[70764]: INFO networking_nsxv3.common.synchronization [req-6d360499-f1ee-496a-ba6f-bae8e75c9724 req-24342d33-d817-4668-854f-d0c2cd1e1ad5 service nova] Enqueued Resource ID: b221064c-6962-44ea-989e-cf4546ea92ab with Priority: HIGHEST for action security_group_members [ 802.804709] env[70764]: INFO networking_nsxv3.common.synchronization [req-6d360499-f1ee-496a-ba6f-bae8e75c9724 req-24342d33-d817-4668-854f-d0c2cd1e1ad5 service nova] Enqueued Resource ID: 354f32d5-8e58-4808-9fe7-c3c2581f19b2 with Priority: HIGHEST for action port [ 802.804941] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b221064c-6962-44ea-989e-cf4546ea92ab with Priority: HIGHEST for action security_group_rules [ 802.805079] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b221064c-6962-44ea-989e-cf4546ea92ab with Priority: HIGHEST for action security_group_members [ 802.805175] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 354f32d5-8e58-4808-9fe7-c3c2581f19b2 with Priority: HIGHEST for action port [ 802.805717] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b221064c-6962-44ea-989e-cf4546ea92ab taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.805842] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b221064c-6962-44ea-989e-cf4546ea92ab" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.805908] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b221064c-6962-44ea-989e-cf4546ea92ab" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.806266] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b221064c-6962-44ea-989e-cf4546ea92ab" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.806364] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b221064c-6962-44ea-989e-cf4546ea92ab',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.807920] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-b221064c-6962-44ea-989e-cf4546ea92ab taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.808181] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b221064c-6962-44ea-989e-cf4546ea92ab" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.808261] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b221064c-6962-44ea-989e-cf4546ea92ab" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.808435] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b221064c-6962-44ea-989e-cf4546ea92ab" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.809047] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.809175] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.809249] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.809400] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.809488] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.809576] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b221064c-6962-44ea-989e-cf4546ea92ab',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.810528] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-354f32d5-8e58-4808-9fe7-c3c2581f19b2 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.810528] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-354f32d5-8e58-4808-9fe7-c3c2581f19b2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.810528] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-354f32d5-8e58-4808-9fe7-c3c2581f19b2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.810657] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-354f32d5-8e58-4808-9fe7-c3c2581f19b2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.810657] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('354f32d5-8e58-4808-9fe7-c3c2581f19b2',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.848839] env[70764]: INFO networking_nsxv3.common.synchronization [req-08a27cc4-f8a9-40ad-b956-7d40362042c9 req-85fcfbd4-0d8c-4927-9bf0-6ae0a0d53f25 tempest-ServersTestManualDisk-1468672688 tempest-ServersTestManualDisk-1468672688-project-member] Enqueued Resource ID: 4402a532-4a5c-4a18-993a-a6249c552031 with Priority: HIGHEST for action security_group_members [ 802.849345] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4402a532-4a5c-4a18-993a-a6249c552031 with Priority: HIGHEST for action security_group_members [ 802.849653] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4402a532-4a5c-4a18-993a-a6249c552031 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.849777] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4402a532-4a5c-4a18-993a-a6249c552031" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.849846] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4402a532-4a5c-4a18-993a-a6249c552031" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.850563] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4402a532-4a5c-4a18-993a-a6249c552031" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.850736] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.850845] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.850905] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.851141] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.851240] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.851336] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4402a532-4a5c-4a18-993a-a6249c552031',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.141762] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3 in Status: SUCCESS [ 803.142625] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.142823] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.143140] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.143365] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.143693] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.143771] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.143971] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.144091] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.144185] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.144304] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.182218] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-793 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.182218] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-793" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.182218] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-793" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.182218] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-793" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.182218] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.182218] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.182218] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.182218] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.182218] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.182218] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 803.182218] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 803.182218] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 803.182218] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 803.182743] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 803.182743] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 803.182743] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 803.213167] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 803.213414] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 803.213606] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 803.213832] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-793" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.214229] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-61a2fece-76dc-4fb3-852a-9318446974f3 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.214464] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-61a2fece-76dc-4fb3-852a-9318446974f3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.214605] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-61a2fece-76dc-4fb3-852a-9318446974f3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.214970] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-61a2fece-76dc-4fb3-852a-9318446974f3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.215351] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61a2fece-76dc-4fb3-852a-9318446974f3',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.312166] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-b221064c-6962-44ea-989e-cf4546ea92ab taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.312366] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b221064c-6962-44ea-989e-cf4546ea92ab" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.313733] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b221064c-6962-44ea-989e-cf4546ea92ab',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.314702] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 354f32d5-8e58-4808-9fe7-c3c2581f19b2 with status ACTIVE [ 803.314905] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.315076] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.315142] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.316298] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.316298] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.316298] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.316298] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.316298] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.316298] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.316298] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.316298] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.316298] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.316642] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.316642] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.316642] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.316642] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 354f32d5-8e58-4808-9fe7-c3c2581f19b2 is going to be updated. [ 803.345092] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.345092] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.345092] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.345092] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.345092] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.345092] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-354f32d5-8e58-4808-9fe7-c3c2581f19b2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.354588] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.354588] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.354588] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.354588] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.354588] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.354588] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.354588] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.354588] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.354588] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.354588] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.354588] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4402a532-4a5c-4a18-993a-a6249c552031 already deleted. [ 803.354588] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4402a532-4a5c-4a18-993a-a6249c552031" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.647704] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.647907] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.647962] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.648162] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.648358] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.648476] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.648520] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.648667] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.648747] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.648919] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.648971] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.649093] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.649135] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.649320] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.649449] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.649505] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.649543] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.649674] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.649752] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.649820] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.649912] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.718188] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.718434] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.718560] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.718888] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.719050] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.719273] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 61a2fece-76dc-4fb3-852a-9318446974f3 not found, creating... [ 803.719601] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.719814] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.719959] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.720253] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.720347] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.720702] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.720801] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.720927] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.721199] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.721346] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.721489] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 61a2fece-76dc-4fb3-852a-9318446974f3 is going to be created. [ 803.741726] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.741969] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.742299] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.742745] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.743544] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.743544] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-61a2fece-76dc-4fb3-852a-9318446974f3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.820314] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b221064c-6962-44ea-989e-cf4546ea92ab',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.072110] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a93825c-656b-4f3f-b946-3346edd746bf in Status: SUCCESS [ 804.072424] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.151629] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3: rpc.has_security_group_logging(os_id): False [ 804.180091] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.180091] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.180091] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.180091] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.180091] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.180701] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.180701] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.180701] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.180701] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.180834] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.181157] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.181157] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.181287] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.181338] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.181437] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.181595] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.181694] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.181781] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.181942] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.182080] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.182184] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3 is going to be created. [ 804.252233] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.252413] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.252461] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.252665] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.252841] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.263093] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3 in Status: IN_PROGRESS for 2s [ 804.323287] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.323922] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.323922] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.323922] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.324088] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.324088] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b221064c-6962-44ea-989e-cf4546ea92ab is going to be created. [ 804.352661] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.352825] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.352896] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.353136] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.353308] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.365319] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b221064c-6962-44ea-989e-cf4546ea92ab in Status: UNINITIALIZED for 2s [ 804.442386] env[70764]: INFO networking_nsxv3.common.synchronization [req-08a27cc4-f8a9-40ad-b956-7d40362042c9 req-1cc58e85-dd7f-429d-9782-669be76f8753 service nova] Enqueued Resource ID: 4402a532-4a5c-4a18-993a-a6249c552031 with Priority: HIGHEST for action security_group_rules [ 804.442678] env[70764]: INFO networking_nsxv3.common.synchronization [req-08a27cc4-f8a9-40ad-b956-7d40362042c9 req-1cc58e85-dd7f-429d-9782-669be76f8753 service nova] Enqueued Resource ID: 4402a532-4a5c-4a18-993a-a6249c552031 with Priority: HIGHEST for action security_group_members [ 804.442678] env[70764]: INFO networking_nsxv3.common.synchronization [req-08a27cc4-f8a9-40ad-b956-7d40362042c9 req-1cc58e85-dd7f-429d-9782-669be76f8753 service nova] Enqueued Resource ID: 61a2fece-76dc-4fb3-852a-9318446974f3 with Priority: HIGHEST for action port [ 804.443333] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4402a532-4a5c-4a18-993a-a6249c552031 with Priority: HIGHEST for action security_group_rules [ 804.443521] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4402a532-4a5c-4a18-993a-a6249c552031 with Priority: HIGHEST for action security_group_members [ 804.443636] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61a2fece-76dc-4fb3-852a-9318446974f3 with Priority: HIGHEST for action port [ 804.443948] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4402a532-4a5c-4a18-993a-a6249c552031 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.444091] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4402a532-4a5c-4a18-993a-a6249c552031" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.444210] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4402a532-4a5c-4a18-993a-a6249c552031" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.446477] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4402a532-4a5c-4a18-993a-a6249c552031" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.446477] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4402a532-4a5c-4a18-993a-a6249c552031',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.446477] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4402a532-4a5c-4a18-993a-a6249c552031 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.446477] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4402a532-4a5c-4a18-993a-a6249c552031" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.446477] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4402a532-4a5c-4a18-993a-a6249c552031" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.446477] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4402a532-4a5c-4a18-993a-a6249c552031" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.446477] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.446477] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.446477] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.446920] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.446920] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.446920] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4402a532-4a5c-4a18-993a-a6249c552031',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.456334] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-61a2fece-76dc-4fb3-852a-9318446974f3 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.456645] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-61a2fece-76dc-4fb3-852a-9318446974f3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.456717] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-61a2fece-76dc-4fb3-852a-9318446974f3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.456983] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-61a2fece-76dc-4fb3-852a-9318446974f3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.457092] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61a2fece-76dc-4fb3-852a-9318446974f3',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.475748] env[70764]: INFO networking_nsxv3.common.synchronization [req-721e285c-b1c9-42ef-892c-9bda46c3b9b9 req-bd765bf3-42bc-4d4f-b98f-b47f552c4912 tempest-ServersAdminNegativeTestJSON-803035860 tempest-ServersAdminNegativeTestJSON-803035860-project-member] Enqueued Resource ID: a793445b-22a7-4c79-b31c-1beebe657659 with Priority: HIGHEST for action security_group_members [ 804.476823] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a793445b-22a7-4c79-b31c-1beebe657659 with Priority: HIGHEST for action security_group_members [ 804.477443] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-a793445b-22a7-4c79-b31c-1beebe657659 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.477582] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.477660] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.477885] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.478065] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.478166] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.478227] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.478377] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.478459] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.478553] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a793445b-22a7-4c79-b31c-1beebe657659',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.956817] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4402a532-4a5c-4a18-993a-a6249c552031',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.960501] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 61a2fece-76dc-4fb3-852a-9318446974f3 with status ACTIVE [ 804.960637] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.960830] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.960937] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.961926] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.962048] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.962253] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.962517] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.962589] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.962761] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.962842] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.963039] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.963163] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.963244] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.963337] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.963471] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.963727] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 61a2fece-76dc-4fb3-852a-9318446974f3 is going to be updated. [ 804.965036] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4402a532-4a5c-4a18-993a-a6249c552031 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.965203] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4402a532-4a5c-4a18-993a-a6249c552031" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.981642] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.981902] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.982024] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.982331] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.986545] env[70764]: INFO networking_nsxv3.common.synchronization [req-344fd763-7fdf-4191-9f76-8b98e49a01a8 req-34c9870a-37be-4330-a546-12c3dc64cb36 tempest-SecurityGroupsTestJSON-512195178 tempest-SecurityGroupsTestJSON-512195178-project-member] Enqueued Resource ID: fdc56614-fc86-49b5-b218-5339e368633a with Priority: HIGHEST for action security_group_members [ 804.986822] env[70764]: INFO networking_nsxv3.common.synchronization [req-344fd763-7fdf-4191-9f76-8b98e49a01a8 req-34c9870a-37be-4330-a546-12c3dc64cb36 tempest-SecurityGroupsTestJSON-512195178 tempest-SecurityGroupsTestJSON-512195178-project-member] Enqueued Resource ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b with Priority: HIGHEST for action security_group_members [ 804.987016] env[70764]: INFO networking_nsxv3.common.synchronization [req-344fd763-7fdf-4191-9f76-8b98e49a01a8 req-34c9870a-37be-4330-a546-12c3dc64cb36 tempest-SecurityGroupsTestJSON-512195178 tempest-SecurityGroupsTestJSON-512195178-project-member] Enqueued Resource ID: 18c40e3b-51cd-431a-858a-22168889b4fd with Priority: HIGHEST for action security_group_members [ 804.991156] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.991156] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.991156] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.991156] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.991156] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.991156] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-61a2fece-76dc-4fb3-852a-9318446974f3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.991156] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdc56614-fc86-49b5-b218-5339e368633a with Priority: HIGHEST for action security_group_members [ 804.991156] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b with Priority: HIGHEST for action security_group_members [ 804.991156] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18c40e3b-51cd-431a-858a-22168889b4fd with Priority: HIGHEST for action security_group_members [ 804.991156] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdc56614-fc86-49b5-b218-5339e368633a taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.991681] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdc56614-fc86-49b5-b218-5339e368633a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.991681] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdc56614-fc86-49b5-b218-5339e368633a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.991681] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdc56614-fc86-49b5-b218-5339e368633a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.992112] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.992936] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.993106] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.993337] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.993477] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.993810] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdc56614-fc86-49b5-b218-5339e368633a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.994965] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.995344] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.995476] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.995848] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.996028] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.996221] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.996355] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.996413] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.996601] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.996720] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.999242] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-18c40e3b-51cd-431a-858a-22168889b4fd taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.999242] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18c40e3b-51cd-431a-858a-22168889b4fd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.999242] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18c40e3b-51cd-431a-858a-22168889b4fd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.999242] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18c40e3b-51cd-431a-858a-22168889b4fd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.999242] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.999242] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.999242] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.999242] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.999242] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.999663] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18c40e3b-51cd-431a-858a-22168889b4fd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.008303] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.008578] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.008702] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.008761] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.008956] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.009075] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.009175] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a793445b-22a7-4c79-b31c-1beebe657659 is going to be updated. [ 805.037883] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.037883] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.038027] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.038186] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.038333] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.046310] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a793445b-22a7-4c79-b31c-1beebe657659 in Status: IN_PROGRESS for 2s [ 805.460883] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4402a532-4a5c-4a18-993a-a6249c552031',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.501430] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.501587] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.501587] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.501758] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.505159] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.505159] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.505159] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.505159] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.522639] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.522639] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.522639] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.522639] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.522639] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.522639] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.522639] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdc56614-fc86-49b5-b218-5339e368633a is going to be updated. [ 805.523272] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.523447] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.523536] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.523720] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.523826] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.523889] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.524365] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.524365] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.524365] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b is going to be updated. [ 805.525151] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.525380] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.538253] env[70764]: INFO networking_nsxv3.common.synchronization [req-f522fec9-6444-41dc-859a-6070094bd9ef req-a06709a4-a295-492c-8539-fb74f679636d tempest-ImagesTestJSON-1647743380 tempest-ImagesTestJSON-1647743380-project-member] Enqueued Resource ID: 4580d502-1d18-4681-96a4-28ac4e291d69 with Priority: HIGHEST for action security_group_members [ 805.538907] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4580d502-1d18-4681-96a4-28ac4e291d69 with Priority: HIGHEST for action security_group_members [ 805.539234] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4580d502-1d18-4681-96a4-28ac4e291d69 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.539354] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.539551] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.539610] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.539742] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.540188] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.540188] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.540188] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.540188] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.540319] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4580d502-1d18-4681-96a4-28ac4e291d69',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.547690] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.547930] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.548026] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.550099] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.550655] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.550655] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.550655] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18c40e3b-51cd-431a-858a-22168889b4fd is going to be updated. [ 805.555868] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.555956] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.556035] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.556217] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.556617] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.557940] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.558208] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.558278] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.558439] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.558567] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.565818] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b in Status: IN_PROGRESS for 2s [ 805.566374] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdc56614-fc86-49b5-b218-5339e368633a in Status: IN_PROGRESS for 2s [ 805.582530] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.582530] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.582530] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.582530] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.582530] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.588397] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18c40e3b-51cd-431a-858a-22168889b4fd in Status: IN_PROGRESS for 2s [ 805.966271] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.966451] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.966515] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.966711] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.966800] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.966896] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4402a532-4a5c-4a18-993a-a6249c552031 is going to be created. [ 805.988248] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.988432] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.988497] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.988687] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.989180] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.999299] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4402a532-4a5c-4a18-993a-a6249c552031 in Status: UNINITIALIZED for 2s [ 806.055039] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.055219] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.055289] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.055538] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.077026] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.077597] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.077597] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.077597] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.077905] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.077905] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.077905] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4580d502-1d18-4681-96a4-28ac4e291d69 is going to be updated. [ 806.088804] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-828 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.088804] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-828" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.088804] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-828" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.089172] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-828" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.089489] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.089722] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.089888] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.090177] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.090380] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.090632] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 806.090794] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 806.091070] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 806.091070] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 806.091300] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 806.092043] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 806.092043] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 806.106247] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.106653] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.106653] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.106844] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.107115] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.120962] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4580d502-1d18-4681-96a4-28ac4e291d69 in Status: IN_PROGRESS for 2s [ 806.122017] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 806.122229] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 806.122363] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 806.122531] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-828" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.122932] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-eb7a173e-9ecd-4c0a-ad0b-71fe62bf7dcf taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.127520] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-eb7a173e-9ecd-4c0a-ad0b-71fe62bf7dcf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.127520] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-eb7a173e-9ecd-4c0a-ad0b-71fe62bf7dcf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.127609] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-eb7a173e-9ecd-4c0a-ad0b-71fe62bf7dcf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.127753] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb7a173e-9ecd-4c0a-ad0b-71fe62bf7dcf',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.275400] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3 in Status: SUCCESS [ 806.275694] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.382333] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b221064c-6962-44ea-989e-cf4546ea92ab in Status: SUCCESS [ 806.382742] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b221064c-6962-44ea-989e-cf4546ea92ab" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.382878] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b221064c-6962-44ea-989e-cf4546ea92ab" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.383280] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b221064c-6962-44ea-989e-cf4546ea92ab" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.383507] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.383717] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.383857] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.384137] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.384269] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.384415] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b221064c-6962-44ea-989e-cf4546ea92ab" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.384529] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b221064c-6962-44ea-989e-cf4546ea92ab',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.632405] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.632691] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.632845] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.633213] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.633378] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.633539] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port eb7a173e-9ecd-4c0a-ad0b-71fe62bf7dcf not found, creating... [ 806.633839] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.634017] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.634140] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.634390] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.634539] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.634865] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.635057] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.635203] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.635444] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.635649] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.635815] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: eb7a173e-9ecd-4c0a-ad0b-71fe62bf7dcf is going to be created. [ 806.658502] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.659290] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.659290] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.659290] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.659469] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.659868] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-eb7a173e-9ecd-4c0a-ad0b-71fe62bf7dcf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.887679] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b221064c-6962-44ea-989e-cf4546ea92ab',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.057225] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a793445b-22a7-4c79-b31c-1beebe657659 in Status: SUCCESS [ 807.057225] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a793445b-22a7-4c79-b31c-1beebe657659 deletion is rescheduled due to dependency. [ 807.057225] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.391043] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b221064c-6962-44ea-989e-cf4546ea92ab: rpc.has_security_group_logging(os_id): False [ 807.408872] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.409030] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.409109] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.409330] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.409424] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.409678] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.409784] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.409857] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.410025] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.410104] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.410193] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b221064c-6962-44ea-989e-cf4546ea92ab is going to be created. [ 807.479922] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.480164] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.480164] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.480363] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.480548] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.491103] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b221064c-6962-44ea-989e-cf4546ea92ab in Status: IN_PROGRESS for 2s [ 807.584152] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdc56614-fc86-49b5-b218-5339e368633a in Status: SUCCESS [ 807.584409] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdc56614-fc86-49b5-b218-5339e368633a deletion is rescheduled due to dependency. [ 807.584538] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdc56614-fc86-49b5-b218-5339e368633a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.585471] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b in Status: SUCCESS [ 807.585637] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b deletion is rescheduled due to dependency. [ 807.585766] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.597666] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18c40e3b-51cd-431a-858a-22168889b4fd in Status: SUCCESS [ 807.597821] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18c40e3b-51cd-431a-858a-22168889b4fd deletion is rescheduled due to dependency. [ 807.597910] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18c40e3b-51cd-431a-858a-22168889b4fd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.773454] env[70764]: INFO networking_nsxv3.common.synchronization [req-f522fec9-6444-41dc-859a-6070094bd9ef req-8621ddfa-0aa8-4e8e-b676-c1f4fda3a909 service nova] Enqueued Resource ID: 4580d502-1d18-4681-96a4-28ac4e291d69 with Priority: HIGHEST for action security_group_rules [ 807.773719] env[70764]: INFO networking_nsxv3.common.synchronization [req-f522fec9-6444-41dc-859a-6070094bd9ef req-8621ddfa-0aa8-4e8e-b676-c1f4fda3a909 service nova] Enqueued Resource ID: 4580d502-1d18-4681-96a4-28ac4e291d69 with Priority: HIGHEST for action security_group_members [ 807.773761] env[70764]: INFO networking_nsxv3.common.synchronization [req-f522fec9-6444-41dc-859a-6070094bd9ef req-8621ddfa-0aa8-4e8e-b676-c1f4fda3a909 service nova] Enqueued Resource ID: eb7a173e-9ecd-4c0a-ad0b-71fe62bf7dcf with Priority: HIGHEST for action port [ 807.773984] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4580d502-1d18-4681-96a4-28ac4e291d69 with Priority: HIGHEST for action security_group_rules [ 807.774117] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4580d502-1d18-4681-96a4-28ac4e291d69 with Priority: HIGHEST for action security_group_members [ 807.774245] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb7a173e-9ecd-4c0a-ad0b-71fe62bf7dcf with Priority: HIGHEST for action port [ 807.774727] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4580d502-1d18-4681-96a4-28ac4e291d69 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.774844] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.774939] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.776233] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.776341] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4580d502-1d18-4681-96a4-28ac4e291d69',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.777597] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4580d502-1d18-4681-96a4-28ac4e291d69 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.777816] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.778336] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb7a173e-9ecd-4c0a-ad0b-71fe62bf7dcf taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.778485] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb7a173e-9ecd-4c0a-ad0b-71fe62bf7dcf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.778573] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb7a173e-9ecd-4c0a-ad0b-71fe62bf7dcf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.780027] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb7a173e-9ecd-4c0a-ad0b-71fe62bf7dcf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.780027] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb7a173e-9ecd-4c0a-ad0b-71fe62bf7dcf',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.009574] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4402a532-4a5c-4a18-993a-a6249c552031 in Status: SUCCESS [ 808.010032] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4402a532-4a5c-4a18-993a-a6249c552031" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.010032] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4402a532-4a5c-4a18-993a-a6249c552031" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.010191] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4402a532-4a5c-4a18-993a-a6249c552031" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.010381] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.010996] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.010996] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.010996] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.010996] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.010996] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4402a532-4a5c-4a18-993a-a6249c552031" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.010996] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4402a532-4a5c-4a18-993a-a6249c552031',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.131394] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4580d502-1d18-4681-96a4-28ac4e291d69 in Status: IN_PROGRESS for 4s [ 808.278295] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4580d502-1d18-4681-96a4-28ac4e291d69 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.279274] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.281887] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eb7a173e-9ecd-4c0a-ad0b-71fe62bf7dcf with status ACTIVE [ 808.281986] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.282136] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.282284] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.282516] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.282605] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.282788] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.282887] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.282947] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.283110] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.283188] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.283368] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.283476] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.283537] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.283675] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.283749] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.283832] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eb7a173e-9ecd-4c0a-ad0b-71fe62bf7dcf is going to be updated. [ 808.303763] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.303923] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.304037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.304237] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.304429] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.304635] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb7a173e-9ecd-4c0a-ad0b-71fe62bf7dcf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.406552] env[70764]: INFO networking_nsxv3.common.synchronization [req-9793bfac-b8e3-4042-9b19-735323f3ab59 req-e4611c3a-0b35-4e04-a313-a04a6df8e316 tempest-ServerRescueTestJSON-867055778 tempest-ServerRescueTestJSON-867055778-project-member] Enqueued Resource ID: ffefe95f-97fb-4dd1-96fc-f444084d7691 with Priority: HIGHEST for action security_group_members [ 808.407234] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffefe95f-97fb-4dd1-96fc-f444084d7691 with Priority: HIGHEST for action security_group_members [ 808.407679] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffefe95f-97fb-4dd1-96fc-f444084d7691 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.407990] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.408168] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.408622] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.408893] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.409151] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.409317] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.409578] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.409768] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.409948] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ffefe95f-97fb-4dd1-96fc-f444084d7691',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.515452] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4402a532-4a5c-4a18-993a-a6249c552031',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.911845] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.912193] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.912193] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.912364] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.912476] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.912688] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.913634] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.913634] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.913634] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.913634] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.913634] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffefe95f-97fb-4dd1-96fc-f444084d7691 already deleted. [ 808.913634] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.957112] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-296 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.957362] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-296" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.957499] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-296" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.958157] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-296" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.961926] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.962544] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.962680] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.963297] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.963738] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.964031] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 808.964314] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 808.964375] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 808.964487] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 808.964632] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 808.964749] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 808.964892] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 808.989021] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 808.989021] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 808.989021] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 808.989021] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-296" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.989021] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-e5b9eb8e-9c4b-4070-9451-a55f8ab8737c taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.989021] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-e5b9eb8e-9c4b-4070-9451-a55f8ab8737c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.989021] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-e5b9eb8e-9c4b-4070-9451-a55f8ab8737c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.989021] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-e5b9eb8e-9c4b-4070-9451-a55f8ab8737c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.989021] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5b9eb8e-9c4b-4070-9451-a55f8ab8737c',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.016845] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4402a532-4a5c-4a18-993a-a6249c552031: rpc.has_security_group_logging(os_id): False [ 809.035633] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.035877] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.035877] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.036071] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.036168] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.036441] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.036612] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.036673] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.036860] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.036942] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.037042] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4402a532-4a5c-4a18-993a-a6249c552031 is going to be created. [ 809.093362] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.094686] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.094686] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.094686] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.094686] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.104307] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4402a532-4a5c-4a18-993a-a6249c552031 in Status: IN_PROGRESS for 2s [ 809.492259] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.492498] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.492674] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.492967] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.493151] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.493309] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port e5b9eb8e-9c4b-4070-9451-a55f8ab8737c not found, creating... [ 809.493574] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.493727] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.493842] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.494075] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.494214] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.494517] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.494666] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.494789] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.495128] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.495296] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.495480] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: e5b9eb8e-9c4b-4070-9451-a55f8ab8737c is going to be created. [ 809.517081] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b221064c-6962-44ea-989e-cf4546ea92ab in Status: SUCCESS [ 809.517372] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b221064c-6962-44ea-989e-cf4546ea92ab" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.528033] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.528033] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.528033] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.528033] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.528033] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.528338] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-e5b9eb8e-9c4b-4070-9451-a55f8ab8737c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.141072] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4580d502-1d18-4681-96a4-28ac4e291d69 in Status: SUCCESS [ 810.141072] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4580d502-1d18-4681-96a4-28ac4e291d69 deletion is rescheduled due to dependency. [ 810.142188] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.142188] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.142188] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.142188] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.142188] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.142188] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.142188] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.142188] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.142188] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4580d502-1d18-4681-96a4-28ac4e291d69',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.404531] env[70764]: INFO networking_nsxv3.common.synchronization [req-9793bfac-b8e3-4042-9b19-735323f3ab59 req-4cc4b065-0cd8-4326-bd3f-9a875b1fa9b6 service nova] Enqueued Resource ID: ffefe95f-97fb-4dd1-96fc-f444084d7691 with Priority: HIGHEST for action security_group_rules [ 810.404695] env[70764]: INFO networking_nsxv3.common.synchronization [req-9793bfac-b8e3-4042-9b19-735323f3ab59 req-4cc4b065-0cd8-4326-bd3f-9a875b1fa9b6 service nova] Enqueued Resource ID: ffefe95f-97fb-4dd1-96fc-f444084d7691 with Priority: HIGHEST for action security_group_members [ 810.404834] env[70764]: INFO networking_nsxv3.common.synchronization [req-9793bfac-b8e3-4042-9b19-735323f3ab59 req-4cc4b065-0cd8-4326-bd3f-9a875b1fa9b6 service nova] Enqueued Resource ID: e5b9eb8e-9c4b-4070-9451-a55f8ab8737c with Priority: HIGHEST for action port [ 810.405071] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffefe95f-97fb-4dd1-96fc-f444084d7691 with Priority: HIGHEST for action security_group_rules [ 810.405199] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffefe95f-97fb-4dd1-96fc-f444084d7691 with Priority: HIGHEST for action security_group_members [ 810.405296] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b9eb8e-9c4b-4070-9451-a55f8ab8737c with Priority: HIGHEST for action port [ 810.405832] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ffefe95f-97fb-4dd1-96fc-f444084d7691 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.406064] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.406064] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.406256] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.406464] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ffefe95f-97fb-4dd1-96fc-f444084d7691',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.407200] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffefe95f-97fb-4dd1-96fc-f444084d7691 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.407319] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.407319] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.407486] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.407633] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.407727] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.407787] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.407925] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.408016] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.408101] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ffefe95f-97fb-4dd1-96fc-f444084d7691',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.408788] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5b9eb8e-9c4b-4070-9451-a55f8ab8737c taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.408876] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5b9eb8e-9c4b-4070-9451-a55f8ab8737c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.408939] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5b9eb8e-9c4b-4070-9451-a55f8ab8737c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.409307] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5b9eb8e-9c4b-4070-9451-a55f8ab8737c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.409307] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5b9eb8e-9c4b-4070-9451-a55f8ab8737c',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.645614] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4580d502-1d18-4681-96a4-28ac4e291d69',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.911682] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ffefe95f-97fb-4dd1-96fc-f444084d7691',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.912775] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffefe95f-97fb-4dd1-96fc-f444084d7691 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.912775] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.920266] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e5b9eb8e-9c4b-4070-9451-a55f8ab8737c with status ACTIVE [ 810.920266] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.920266] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.920266] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.920266] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.920266] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.920266] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.920266] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.920266] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.920266] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.920266] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.920266] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.920266] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.920266] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.920266] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.920266] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.920266] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e5b9eb8e-9c4b-4070-9451-a55f8ab8737c is going to be updated. [ 810.938903] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.939075] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.940021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.940021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.940021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.940021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5b9eb8e-9c4b-4070-9451-a55f8ab8737c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.117696] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4402a532-4a5c-4a18-993a-a6249c552031 in Status: SUCCESS [ 811.117696] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4402a532-4a5c-4a18-993a-a6249c552031" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.148253] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4580d502-1d18-4681-96a4-28ac4e291d69',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.413281] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ffefe95f-97fb-4dd1-96fc-f444084d7691',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.652431] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.652663] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.652724] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.653027] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.655100] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.655100] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4580d502-1d18-4681-96a4-28ac4e291d69 is going to be updated. [ 811.680324] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.680472] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.680535] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.680751] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.680915] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.692151] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4580d502-1d18-4681-96a4-28ac4e291d69 in Status: IN_PROGRESS for 2s [ 811.915713] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.915903] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.915979] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.916214] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.916307] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.916410] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffefe95f-97fb-4dd1-96fc-f444084d7691 is going to be created. [ 811.941118] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.941330] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.942024] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.942024] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.942024] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.952252] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffefe95f-97fb-4dd1-96fc-f444084d7691 in Status: UNINITIALIZED for 2s [ 813.236128] env[70764]: INFO networking_nsxv3.common.synchronization [None req-f6ef8186-302f-4a00-bf1b-c0ba21d09971 None None] Enqueued Resource ID: b414182d-b80f-40ac-919b-af9f3ba6bfd0 with Priority: HIGHEST for action port [ 813.236475] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b414182d-b80f-40ac-919b-af9f3ba6bfd0 with Priority: HIGHEST for action port [ 813.236990] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-b414182d-b80f-40ac-919b-af9f3ba6bfd0 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.237129] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b414182d-b80f-40ac-919b-af9f3ba6bfd0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.237195] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b414182d-b80f-40ac-919b-af9f3ba6bfd0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.237477] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b414182d-b80f-40ac-919b-af9f3ba6bfd0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.237660] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b414182d-b80f-40ac-919b-af9f3ba6bfd0',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.448914] env[70764]: INFO networking_nsxv3.common.synchronization [req-f24f5017-6a4b-428f-bba3-b99fbe114355 req-f8da82d7-b51d-451c-9ffb-f6d12e36b754 tempest-AttachVolumeShelveTestJSON-384280106 tempest-AttachVolumeShelveTestJSON-384280106-project-member] Enqueued Resource ID: 9c661804-19d8-4b01-b7d8-b4d1885cc85f with Priority: HIGHEST for action security_group_members [ 813.452671] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c661804-19d8-4b01-b7d8-b4d1885cc85f with Priority: HIGHEST for action security_group_members [ 813.452671] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c661804-19d8-4b01-b7d8-b4d1885cc85f taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.452671] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.452671] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.452671] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.452671] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.452671] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.452671] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.452671] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.452671] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.452671] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c661804-19d8-4b01-b7d8-b4d1885cc85f',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.704022] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4580d502-1d18-4681-96a4-28ac4e291d69 in Status: SUCCESS [ 813.704022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.704022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.704022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.704022] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.704022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.704022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.704022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.704022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.704022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.704022] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4580d502-1d18-4681-96a4-28ac4e291d69',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.740947] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b414182d-b80f-40ac-919b-af9f3ba6bfd0 [ 813.740947] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.740947] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.740947] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.740947] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.740947] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.740947] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b414182d-b80f-40ac-919b-af9f3ba6bfd0 already deleted. [ 813.740947] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b414182d-b80f-40ac-919b-af9f3ba6bfd0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.893306] env[70764]: INFO networking_nsxv3.common.synchronization [req-78169b83-65c7-479c-a837-12901fb47356 req-f19585b6-1a7a-4508-bb34-4c751d5054fb tempest-ServersNegativeTestMultiTenantJSON-2110591191 tempest-ServersNegativeTestMultiTenantJSON-2110591191-project-member] Enqueued Resource ID: 7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3 with Priority: HIGHEST for action security_group_members [ 813.893408] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3 with Priority: HIGHEST for action security_group_members [ 813.893816] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.894236] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.894236] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.894597] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.894597] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.894721] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.894721] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.894860] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.894950] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.895074] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.955053] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.955287] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.955406] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.955710] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.955847] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.956179] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.956288] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.956387] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.956557] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.956639] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.956727] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c661804-19d8-4b01-b7d8-b4d1885cc85f already deleted. [ 813.956806] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.960750] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffefe95f-97fb-4dd1-96fc-f444084d7691 in Status: SUCCESS [ 813.960750] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.961030] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.961201] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.961424] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.961480] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.961536] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.961681] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.961759] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.961841] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.961924] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ffefe95f-97fb-4dd1-96fc-f444084d7691',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.210105] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4580d502-1d18-4681-96a4-28ac4e291d69 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.210105] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.210105] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.210105] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.210105] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.210105] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.210105] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.210105] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.210105] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.210105] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.210105] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4580d502-1d18-4681-96a4-28ac4e291d69 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.210105] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.210105] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.210105] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.210105] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.210105] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.210766] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.210766] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.210766] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.210766] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.210766] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4580d502-1d18-4681-96a4-28ac4e291d69',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.259448] env[70764]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] NSXv3 Agent Agent loop - iteration:0 completed [ 814.260032] env[70764]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] NSXv3 Agent Agent loop - iteration:1 started [ 814.397668] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.397834] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.397908] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.398394] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.398394] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.398519] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.398599] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.398599] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.398885] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.398885] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.399044] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3 is going to be updated. [ 814.435525] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.435717] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.435762] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.435948] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.436214] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.445444] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3 in Status: IN_PROGRESS for 2s [ 814.466396] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffefe95f-97fb-4dd1-96fc-f444084d7691 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.466590] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.466668] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.466885] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.467058] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.467153] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.467215] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.467356] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.467441] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.467524] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.467666] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffefe95f-97fb-4dd1-96fc-f444084d7691 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.467793] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.467863] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.468048] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.468207] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.468303] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.468361] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.468499] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.468572] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.468652] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.468739] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ffefe95f-97fb-4dd1-96fc-f444084d7691',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.713271] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4580d502-1d18-4681-96a4-28ac4e291d69: rpc.has_security_group_logging(os_id): False [ 814.734361] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.734361] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.734361] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.734712] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.734712] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.734875] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.735447] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.735447] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.735447] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.735447] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.735608] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.735608] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.735608] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.735761] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.735823] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.736008] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.736332] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.736389] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.736537] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.736641] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.736748] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4580d502-1d18-4681-96a4-28ac4e291d69 is going to be updated. [ 814.740979] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-175 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.741501] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-175" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.741584] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-175" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.741858] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-175" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.742178] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.743405] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.743405] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.743405] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.743405] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.743696] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 814.743842] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 814.743977] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 814.748545] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 814.748545] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 814.748545] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 814.748545] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 814.751999] env[70764]: INFO networking_nsxv3.common.synchronization [None req-2c2dda02-f59f-458c-80a6-3b62aeb821ab tempest-ServersTestJSON-1873194666 tempest-ServersTestJSON-1873194666-project-member] Enqueued Resource ID: 1e8d083b-4d4e-4192-8c53-ff33df47b5e7 with Priority: HIGHEST for action security_group_rules [ 814.753895] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e8d083b-4d4e-4192-8c53-ff33df47b5e7 with Priority: HIGHEST for action security_group_rules [ 814.754441] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e8d083b-4d4e-4192-8c53-ff33df47b5e7 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.754569] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e8d083b-4d4e-4192-8c53-ff33df47b5e7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.754634] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e8d083b-4d4e-4192-8c53-ff33df47b5e7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.754872] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e8d083b-4d4e-4192-8c53-ff33df47b5e7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.754956] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e8d083b-4d4e-4192-8c53-ff33df47b5e7',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.774233] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 814.774454] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 814.774596] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 814.774776] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-175" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.775506] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-4cf0ffec-9392-4bbb-a4e8-03e4ea2efbb0 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.775645] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-4cf0ffec-9392-4bbb-a4e8-03e4ea2efbb0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.775794] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-4cf0ffec-9392-4bbb-a4e8-03e4ea2efbb0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.776150] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-4cf0ffec-9392-4bbb-a4e8-03e4ea2efbb0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.776214] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4cf0ffec-9392-4bbb-a4e8-03e4ea2efbb0',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.805474] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.805751] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.805828] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.806037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.806184] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.817883] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4580d502-1d18-4681-96a4-28ac4e291d69 in Status: IN_PROGRESS for 2s [ 814.829561] env[70764]: INFO networking_nsxv3.common.synchronization [None req-da650a1e-6a73-4ba1-af72-e416e2d9bc5b tempest-ServersTestJSON-1873194666 tempest-ServersTestJSON-1873194666-project-member] Enqueued Resource ID: 1e8d083b-4d4e-4192-8c53-ff33df47b5e7 with Priority: HIGHEST for action security_group_rules [ 814.830251] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e8d083b-4d4e-4192-8c53-ff33df47b5e7 with Priority: HIGHEST for action security_group_rules [ 814.830948] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e8d083b-4d4e-4192-8c53-ff33df47b5e7 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.831096] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e8d083b-4d4e-4192-8c53-ff33df47b5e7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.977350] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ffefe95f-97fb-4dd1-96fc-f444084d7691: rpc.has_security_group_logging(os_id): False [ 814.994869] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.994869] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.994869] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.995131] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.995131] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.995338] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.995452] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.995505] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.996202] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.996202] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.996202] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.996202] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.996202] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.996202] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.996568] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.996568] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.996568] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.996707] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.996941] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.996941] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.996941] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ffefe95f-97fb-4dd1-96fc-f444084d7691 is going to be created. [ 815.053375] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.053538] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.053600] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.053900] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.054035] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.068145] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ffefe95f-97fb-4dd1-96fc-f444084d7691 in Status: IN_PROGRESS for 2s [ 815.277349] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.278170] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.278170] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.278458] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.278458] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.278458] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e8d083b-4d4e-4192-8c53-ff33df47b5e7 already deleted. [ 815.278575] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e8d083b-4d4e-4192-8c53-ff33df47b5e7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.278685] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e8d083b-4d4e-4192-8c53-ff33df47b5e7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.278837] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e8d083b-4d4e-4192-8c53-ff33df47b5e7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.278926] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e8d083b-4d4e-4192-8c53-ff33df47b5e7',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.281062] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.281321] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.281455] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.281678] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.281816] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.281960] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 4cf0ffec-9392-4bbb-a4e8-03e4ea2efbb0 not found, creating... [ 815.282867] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.283210] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.283366] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.284046] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.284407] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.284848] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.285027] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.285150] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.285364] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.285714] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.285714] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 4cf0ffec-9392-4bbb-a4e8-03e4ea2efbb0 is going to be created. [ 815.310255] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.310349] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.310976] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.310976] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.310976] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.311465] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-4cf0ffec-9392-4bbb-a4e8-03e4ea2efbb0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.638558] env[70764]: INFO networking_nsxv3.common.synchronization [None req-fcbcdc8b-1796-4c1d-8129-0721d3d2ab8c None None] Enqueued Resource ID: 58d16c42-89e1-475a-9baa-a659e388e009 with Priority: HIGHEST for action port [ 815.638558] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d16c42-89e1-475a-9baa-a659e388e009 with Priority: HIGHEST for action port [ 815.638558] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-58d16c42-89e1-475a-9baa-a659e388e009 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.638558] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58d16c42-89e1-475a-9baa-a659e388e009" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.639057] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58d16c42-89e1-475a-9baa-a659e388e009" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.640256] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58d16c42-89e1-475a-9baa-a659e388e009" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.640256] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58d16c42-89e1-475a-9baa-a659e388e009',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.802310] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.802394] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.802488] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.802735] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.802837] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.802934] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e8d083b-4d4e-4192-8c53-ff33df47b5e7 already deleted. [ 815.803033] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e8d083b-4d4e-4192-8c53-ff33df47b5e7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.146348] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 58d16c42-89e1-475a-9baa-a659e388e009 [ 816.146348] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.146348] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.146348] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.146348] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.146348] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.146348] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:58d16c42-89e1-475a-9baa-a659e388e009 already deleted. [ 816.146348] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58d16c42-89e1-475a-9baa-a659e388e009" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.172243] env[70764]: INFO networking_nsxv3.common.synchronization [req-f24f5017-6a4b-428f-bba3-b99fbe114355 req-3d393cbb-3bdd-4f00-93fe-2b1837a5a4ca service nova] Enqueued Resource ID: 9c661804-19d8-4b01-b7d8-b4d1885cc85f with Priority: HIGHEST for action security_group_rules [ 816.172507] env[70764]: INFO networking_nsxv3.common.synchronization [req-f24f5017-6a4b-428f-bba3-b99fbe114355 req-3d393cbb-3bdd-4f00-93fe-2b1837a5a4ca service nova] Enqueued Resource ID: 9c661804-19d8-4b01-b7d8-b4d1885cc85f with Priority: HIGHEST for action security_group_members [ 816.172594] env[70764]: INFO networking_nsxv3.common.synchronization [req-f24f5017-6a4b-428f-bba3-b99fbe114355 req-3d393cbb-3bdd-4f00-93fe-2b1837a5a4ca service nova] Enqueued Resource ID: 4cf0ffec-9392-4bbb-a4e8-03e4ea2efbb0 with Priority: HIGHEST for action port [ 816.173098] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c661804-19d8-4b01-b7d8-b4d1885cc85f with Priority: HIGHEST for action security_group_rules [ 816.173227] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c661804-19d8-4b01-b7d8-b4d1885cc85f with Priority: HIGHEST for action security_group_members [ 816.173326] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cf0ffec-9392-4bbb-a4e8-03e4ea2efbb0 with Priority: HIGHEST for action port [ 816.177705] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c661804-19d8-4b01-b7d8-b4d1885cc85f taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.178410] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.178824] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.179375] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.179709] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c661804-19d8-4b01-b7d8-b4d1885cc85f',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.181167] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c661804-19d8-4b01-b7d8-b4d1885cc85f taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.181337] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.181412] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.181621] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.181811] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.181923] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.181989] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.182210] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.182337] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.182463] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c661804-19d8-4b01-b7d8-b4d1885cc85f',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.183714] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-4cf0ffec-9392-4bbb-a4e8-03e4ea2efbb0 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.183714] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4cf0ffec-9392-4bbb-a4e8-03e4ea2efbb0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.183714] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4cf0ffec-9392-4bbb-a4e8-03e4ea2efbb0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.183714] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4cf0ffec-9392-4bbb-a4e8-03e4ea2efbb0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.183714] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4cf0ffec-9392-4bbb-a4e8-03e4ea2efbb0',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.455462] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3 in Status: SUCCESS [ 816.455713] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3 deletion is rescheduled due to dependency. [ 816.455786] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.686745] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c661804-19d8-4b01-b7d8-b4d1885cc85f taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.686941] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.687076] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9c661804-19d8-4b01-b7d8-b4d1885cc85f',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.688463] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4cf0ffec-9392-4bbb-a4e8-03e4ea2efbb0 with status ACTIVE [ 816.688650] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.688784] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.688851] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.689058] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.689148] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.689388] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.689486] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.689548] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.689696] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.689772] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.689964] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.691931] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.691931] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.691931] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.691931] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.691931] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4cf0ffec-9392-4bbb-a4e8-03e4ea2efbb0 is going to be updated. [ 816.715277] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.715442] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.715527] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.715702] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.715832] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.716095] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4cf0ffec-9392-4bbb-a4e8-03e4ea2efbb0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.832667] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4580d502-1d18-4681-96a4-28ac4e291d69 in Status: SUCCESS [ 816.832894] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.080805] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ffefe95f-97fb-4dd1-96fc-f444084d7691 in Status: SUCCESS [ 817.080805] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.194191] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9c661804-19d8-4b01-b7d8-b4d1885cc85f',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.698675] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.698675] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.698675] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.699018] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.699018] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.699018] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c661804-19d8-4b01-b7d8-b4d1885cc85f is going to be created. [ 817.721923] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.722449] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.722449] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.722626] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.722779] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.732389] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c661804-19d8-4b01-b7d8-b4d1885cc85f in Status: UNINITIALIZED for 2s [ 819.701206] env[70764]: INFO networking_nsxv3.common.synchronization [req-6b3aaf7b-3f05-4df4-846f-b1debd8ee634 req-f89e350e-4eee-4a48-8715-d2e7f26193cb tempest-ServersTestBootFromVolume-2146126926 tempest-ServersTestBootFromVolume-2146126926-project-member] Enqueued Resource ID: dffe2468-a89e-4c09-9b45-a73f1d41f82e with Priority: HIGHEST for action security_group_members [ 819.701206] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dffe2468-a89e-4c09-9b45-a73f1d41f82e with Priority: HIGHEST for action security_group_members [ 819.701206] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-dffe2468-a89e-4c09-9b45-a73f1d41f82e taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.702225] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dffe2468-a89e-4c09-9b45-a73f1d41f82e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.702225] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dffe2468-a89e-4c09-9b45-a73f1d41f82e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.702966] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dffe2468-a89e-4c09-9b45-a73f1d41f82e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.703223] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.703354] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.703417] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.703713] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.703713] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.703846] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dffe2468-a89e-4c09-9b45-a73f1d41f82e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.747374] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c661804-19d8-4b01-b7d8-b4d1885cc85f in Status: SUCCESS [ 819.747374] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.747374] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.747374] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.747374] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.747374] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.747374] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.747374] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.747374] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.747374] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.747374] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9c661804-19d8-4b01-b7d8-b4d1885cc85f',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.206772] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.206907] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.206946] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.207207] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.207391] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.207485] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.207642] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.207713] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.207973] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.207973] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.208072] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dffe2468-a89e-4c09-9b45-a73f1d41f82e already deleted. [ 820.208116] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dffe2468-a89e-4c09-9b45-a73f1d41f82e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.249443] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9c661804-19d8-4b01-b7d8-b4d1885cc85f',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.394571] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-205 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.394766] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-205" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.394885] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-205" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.395241] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-205" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.395503] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.395656] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.395765] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.396025] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.396124] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.396335] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 820.396527] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 820.396638] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 820.396743] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 820.396848] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 820.396950] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 820.397091] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 820.415894] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 820.416217] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 820.416217] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 820.416760] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-205" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.416760] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-3afe5b95-e420-40cb-8065-64f4d3132fea taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.416919] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-3afe5b95-e420-40cb-8065-64f4d3132fea" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.416955] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-3afe5b95-e420-40cb-8065-64f4d3132fea" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.417336] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-3afe5b95-e420-40cb-8065-64f4d3132fea" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.417433] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3afe5b95-e420-40cb-8065-64f4d3132fea',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.751640] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9c661804-19d8-4b01-b7d8-b4d1885cc85f: rpc.has_security_group_logging(os_id): False [ 820.771954] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.772140] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.772214] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.772789] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.772789] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.772789] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.772913] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.772952] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.773134] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.773212] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.773298] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c661804-19d8-4b01-b7d8-b4d1885cc85f is going to be created. [ 820.838756] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.848046] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.848046] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.848046] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.848046] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.857967] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c661804-19d8-4b01-b7d8-b4d1885cc85f in Status: IN_PROGRESS for 2s [ 820.925762] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.925993] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.926138] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.926610] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.926956] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.926956] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 3afe5b95-e420-40cb-8065-64f4d3132fea not found, creating... [ 820.927234] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.927392] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.927934] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.927934] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.927934] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.928302] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.928536] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.928580] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.928811] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.930461] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.930656] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 3afe5b95-e420-40cb-8065-64f4d3132fea is going to be created. [ 820.962799] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.963035] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.963167] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.963517] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.963783] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.963893] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-3afe5b95-e420-40cb-8065-64f4d3132fea" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.005402] env[70764]: INFO networking_nsxv3.common.synchronization [None req-20254849-9535-4fec-b081-7952b4c36e0c None None] Enqueued Resource ID: bd5f0dd7-3dc8-4259-bd99-2cdc69224811 with Priority: HIGHEST for action port [ 821.005675] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd5f0dd7-3dc8-4259-bd99-2cdc69224811 with Priority: HIGHEST for action port [ 821.006249] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd5f0dd7-3dc8-4259-bd99-2cdc69224811 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.006375] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd5f0dd7-3dc8-4259-bd99-2cdc69224811" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.006444] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd5f0dd7-3dc8-4259-bd99-2cdc69224811" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.006695] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd5f0dd7-3dc8-4259-bd99-2cdc69224811" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.006778] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd5f0dd7-3dc8-4259-bd99-2cdc69224811',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.513959] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bd5f0dd7-3dc8-4259-bd99-2cdc69224811 [ 821.513959] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.513959] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.513959] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.513959] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.513959] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.513959] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bd5f0dd7-3dc8-4259-bd99-2cdc69224811 already deleted. [ 821.513959] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd5f0dd7-3dc8-4259-bd99-2cdc69224811" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.916703] env[70764]: INFO networking_nsxv3.common.synchronization [req-6b3aaf7b-3f05-4df4-846f-b1debd8ee634 req-23109abc-b8f9-4296-a75f-891fc744258f service nova] Enqueued Resource ID: dffe2468-a89e-4c09-9b45-a73f1d41f82e with Priority: HIGHEST for action security_group_rules [ 821.916703] env[70764]: INFO networking_nsxv3.common.synchronization [req-6b3aaf7b-3f05-4df4-846f-b1debd8ee634 req-23109abc-b8f9-4296-a75f-891fc744258f service nova] Enqueued Resource ID: dffe2468-a89e-4c09-9b45-a73f1d41f82e with Priority: HIGHEST for action security_group_members [ 821.916703] env[70764]: INFO networking_nsxv3.common.synchronization [req-6b3aaf7b-3f05-4df4-846f-b1debd8ee634 req-23109abc-b8f9-4296-a75f-891fc744258f service nova] Enqueued Resource ID: 3afe5b95-e420-40cb-8065-64f4d3132fea with Priority: HIGHEST for action port [ 821.916703] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dffe2468-a89e-4c09-9b45-a73f1d41f82e with Priority: HIGHEST for action security_group_rules [ 821.916703] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dffe2468-a89e-4c09-9b45-a73f1d41f82e with Priority: HIGHEST for action security_group_members [ 821.916703] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3afe5b95-e420-40cb-8065-64f4d3132fea with Priority: HIGHEST for action port [ 821.918990] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dffe2468-a89e-4c09-9b45-a73f1d41f82e taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.918990] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dffe2468-a89e-4c09-9b45-a73f1d41f82e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.918990] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dffe2468-a89e-4c09-9b45-a73f1d41f82e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.918990] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dffe2468-a89e-4c09-9b45-a73f1d41f82e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.918990] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dffe2468-a89e-4c09-9b45-a73f1d41f82e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.920094] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-dffe2468-a89e-4c09-9b45-a73f1d41f82e taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.920191] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dffe2468-a89e-4c09-9b45-a73f1d41f82e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.920191] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dffe2468-a89e-4c09-9b45-a73f1d41f82e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.920440] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dffe2468-a89e-4c09-9b45-a73f1d41f82e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.921416] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.921416] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.921416] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.921416] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.921416] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.921416] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dffe2468-a89e-4c09-9b45-a73f1d41f82e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.925157] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-3afe5b95-e420-40cb-8065-64f4d3132fea taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.925157] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3afe5b95-e420-40cb-8065-64f4d3132fea" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.925157] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3afe5b95-e420-40cb-8065-64f4d3132fea" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.925375] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3afe5b95-e420-40cb-8065-64f4d3132fea" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.925375] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3afe5b95-e420-40cb-8065-64f4d3132fea',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.092051] env[70764]: INFO networking_nsxv3.common.synchronization [req-36ea2d05-6943-45f3-9a6c-bdc81bcd780e req-ec5c9671-241e-4015-949c-ff09b10953f6 tempest-ImagesOneServerNegativeTestJSON-1318507346 tempest-ImagesOneServerNegativeTestJSON-1318507346-project-member] Enqueued Resource ID: 2a93825c-656b-4f3f-b946-3346edd746bf with Priority: HIGHEST for action security_group_members [ 822.092051] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a93825c-656b-4f3f-b946-3346edd746bf with Priority: HIGHEST for action security_group_members [ 822.092051] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a93825c-656b-4f3f-b946-3346edd746bf taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.092051] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.092051] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.092051] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.092051] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.092051] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.092051] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.092966] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.093202] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.093596] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a93825c-656b-4f3f-b946-3346edd746bf',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.427589] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-dffe2468-a89e-4c09-9b45-a73f1d41f82e taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.427791] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dffe2468-a89e-4c09-9b45-a73f1d41f82e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.428016] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dffe2468-a89e-4c09-9b45-a73f1d41f82e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.429266] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3afe5b95-e420-40cb-8065-64f4d3132fea with status ACTIVE [ 822.429381] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.429519] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.429596] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.429985] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.429985] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.430178] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.430319] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.430408] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.430599] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.430704] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.430928] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.431039] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.431143] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.431316] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.431403] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.431479] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3afe5b95-e420-40cb-8065-64f4d3132fea is going to be updated. [ 822.453745] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.453915] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.454049] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.454307] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.455232] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.455232] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3afe5b95-e420-40cb-8065-64f4d3132fea" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.595792] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.595792] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.595952] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.596147] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.596233] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.596398] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.596501] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.596564] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.596718] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.596838] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.596927] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a93825c-656b-4f3f-b946-3346edd746bf is going to be updated. [ 822.631199] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.631199] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.631199] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.631480] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.631515] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.641163] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a93825c-656b-4f3f-b946-3346edd746bf in Status: IN_PROGRESS for 2s [ 822.870498] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c661804-19d8-4b01-b7d8-b4d1885cc85f in Status: SUCCESS [ 822.870760] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.934350] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dffe2468-a89e-4c09-9b45-a73f1d41f82e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.242092] env[70764]: INFO networking_nsxv3.common.synchronization [None req-960dc1a9-2f54-4161-b2fb-3915a695b8f3 None None] Enqueued Resource ID: cacb3b2b-7b6d-4a63-8f43-85d70d92ebed with Priority: HIGHEST for action port [ 823.242874] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cacb3b2b-7b6d-4a63-8f43-85d70d92ebed with Priority: HIGHEST for action port [ 823.242874] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-cacb3b2b-7b6d-4a63-8f43-85d70d92ebed taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.242874] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cacb3b2b-7b6d-4a63-8f43-85d70d92ebed" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.243031] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cacb3b2b-7b6d-4a63-8f43-85d70d92ebed" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.244022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cacb3b2b-7b6d-4a63-8f43-85d70d92ebed" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.244022] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cacb3b2b-7b6d-4a63-8f43-85d70d92ebed',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.443020] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.443020] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.443020] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.443020] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.443020] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.443020] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dffe2468-a89e-4c09-9b45-a73f1d41f82e is going to be created. [ 823.462284] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.462284] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.462486] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.465596] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.465596] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.472711] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dffe2468-a89e-4c09-9b45-a73f1d41f82e in Status: UNINITIALIZED for 2s [ 823.747796] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cacb3b2b-7b6d-4a63-8f43-85d70d92ebed [ 823.748074] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.748215] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.748468] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.748533] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.748607] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.748701] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cacb3b2b-7b6d-4a63-8f43-85d70d92ebed already deleted. [ 823.748782] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cacb3b2b-7b6d-4a63-8f43-85d70d92ebed" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.651289] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a93825c-656b-4f3f-b946-3346edd746bf in Status: SUCCESS [ 824.651588] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a93825c-656b-4f3f-b946-3346edd746bf deletion is rescheduled due to dependency. [ 824.651624] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.111675] env[70764]: INFO networking_nsxv3.common.synchronization [req-cf0b7f90-ba6c-4b91-9de9-3641ff6a36e7 req-d1636bf0-28ae-4f50-bf09-9e2df24002fd tempest-ServersAdminTestJSON-868847224 tempest-ServersAdminTestJSON-868847224-project-member] Enqueued Resource ID: 5e9c0048-237b-4cab-86e0-e56dce546daa with Priority: HIGHEST for action security_group_members [ 825.112493] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e9c0048-237b-4cab-86e0-e56dce546daa with Priority: HIGHEST for action security_group_members [ 825.112878] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e9c0048-237b-4cab-86e0-e56dce546daa taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.113060] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.113153] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.113450] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.113735] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.113830] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.113865] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.114079] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.114174] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.114267] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e9c0048-237b-4cab-86e0-e56dce546daa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.484558] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dffe2468-a89e-4c09-9b45-a73f1d41f82e in Status: SUCCESS [ 825.484558] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dffe2468-a89e-4c09-9b45-a73f1d41f82e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.484774] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dffe2468-a89e-4c09-9b45-a73f1d41f82e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.484958] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dffe2468-a89e-4c09-9b45-a73f1d41f82e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.485177] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.485285] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.485350] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.485510] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.485592] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.485692] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dffe2468-a89e-4c09-9b45-a73f1d41f82e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.485786] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dffe2468-a89e-4c09-9b45-a73f1d41f82e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.616663] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e9c0048-237b-4cab-86e0-e56dce546daa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.992024] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dffe2468-a89e-4c09-9b45-a73f1d41f82e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.119224] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e9c0048-237b-4cab-86e0-e56dce546daa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.492717] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dffe2468-a89e-4c09-9b45-a73f1d41f82e: rpc.has_security_group_logging(os_id): False [ 826.510892] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.514215] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.514215] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.514215] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.514215] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.514215] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.514215] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.514215] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.514215] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.514215] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.514215] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dffe2468-a89e-4c09-9b45-a73f1d41f82e is going to be created. [ 826.573183] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.573183] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.573183] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.573183] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.573637] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.583128] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dffe2468-a89e-4c09-9b45-a73f1d41f82e in Status: IN_PROGRESS for 2s [ 826.622881] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.623123] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.623198] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.623415] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.623506] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.625505] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e9c0048-237b-4cab-86e0-e56dce546daa is going to be updated. [ 826.670936] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.671117] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.671247] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.671533] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.671688] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.680204] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e9c0048-237b-4cab-86e0-e56dce546daa in Status: IN_PROGRESS for 2s [ 827.257742] env[70764]: INFO networking_nsxv3.common.synchronization [req-0eac0085-3376-43eb-9dfa-24f3b60f0d67 req-b1d84353-ddd1-4e4d-849b-499e18c5b4f0 tempest-ServersTestJSON-88830314 tempest-ServersTestJSON-88830314-project-member] Enqueued Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_members [ 827.258721] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_members [ 827.259297] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.259555] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.259696] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.260035] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.260398] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.260579] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.260698] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.260998] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.261177] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.261356] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.764426] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.266576] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.298463] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-603 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.298463] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-603" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.298463] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-603" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.298463] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-603" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.298696] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.298696] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.298786] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.298949] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.299584] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.299850] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 828.299969] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 828.300090] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 828.300198] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 828.300308] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 828.300430] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 828.300562] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 828.320517] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 828.320517] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 828.320517] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 828.321027] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-603" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.321099] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-56a70d2b-600e-4ca5-b17e-d171d06fe974 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.321324] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-56a70d2b-600e-4ca5-b17e-d171d06fe974" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.321566] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-56a70d2b-600e-4ca5-b17e-d171d06fe974" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.321760] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-56a70d2b-600e-4ca5-b17e-d171d06fe974" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.321899] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56a70d2b-600e-4ca5-b17e-d171d06fe974',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.596360] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dffe2468-a89e-4c09-9b45-a73f1d41f82e in Status: SUCCESS [ 828.596630] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dffe2468-a89e-4c09-9b45-a73f1d41f82e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.688920] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e9c0048-237b-4cab-86e0-e56dce546daa in Status: SUCCESS [ 828.689390] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.768866] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.769111] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.769160] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.769524] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.769608] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.769667] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8f5efec-a14e-4be6-8add-7b35a995c982 is going to be updated. [ 828.796279] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.796279] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.796279] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.796279] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.796279] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.802740] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: IN_PROGRESS for 2s [ 828.824424] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.824646] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.824773] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.825058] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.825207] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.825357] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 56a70d2b-600e-4ca5-b17e-d171d06fe974 not found, creating... [ 828.825611] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.825768] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.825885] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.826110] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.826246] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.826524] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.826681] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.826796] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.827010] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.827241] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.827387] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 56a70d2b-600e-4ca5-b17e-d171d06fe974 is going to be created. [ 828.846570] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.846762] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.846879] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.847160] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.847376] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.847591] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-56a70d2b-600e-4ca5-b17e-d171d06fe974" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.668043] env[70764]: INFO networking_nsxv3.common.synchronization [req-0eac0085-3376-43eb-9dfa-24f3b60f0d67 req-9a82da74-09a3-4522-bd38-1b70e3343173 service nova] Enqueued Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_rules [ 829.668317] env[70764]: INFO networking_nsxv3.common.synchronization [req-0eac0085-3376-43eb-9dfa-24f3b60f0d67 req-9a82da74-09a3-4522-bd38-1b70e3343173 service nova] Enqueued Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_members [ 829.668317] env[70764]: INFO networking_nsxv3.common.synchronization [req-0eac0085-3376-43eb-9dfa-24f3b60f0d67 req-9a82da74-09a3-4522-bd38-1b70e3343173 service nova] Enqueued Resource ID: 56a70d2b-600e-4ca5-b17e-d171d06fe974 with Priority: HIGHEST for action port [ 829.669745] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_rules [ 829.670198] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_members [ 829.670756] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56a70d2b-600e-4ca5-b17e-d171d06fe974 with Priority: HIGHEST for action port [ 829.671681] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.672041] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.672041] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.672292] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.672391] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.674030] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.674124] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.674342] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-56a70d2b-600e-4ca5-b17e-d171d06fe974 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.674658] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56a70d2b-600e-4ca5-b17e-d171d06fe974" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.674881] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56a70d2b-600e-4ca5-b17e-d171d06fe974" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.675159] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56a70d2b-600e-4ca5-b17e-d171d06fe974" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.675293] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56a70d2b-600e-4ca5-b17e-d171d06fe974',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.179478] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 56a70d2b-600e-4ca5-b17e-d171d06fe974 with status ACTIVE [ 830.179754] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.179899] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.179968] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.180276] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.180440] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.180594] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.180697] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.180762] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.180983] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.181121] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.181369] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.181500] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.181544] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.181689] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.181797] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.181920] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 56a70d2b-600e-4ca5-b17e-d171d06fe974 is going to be updated. [ 830.187220] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.187382] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.208310] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.208310] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.208310] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.208310] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.208310] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.208310] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56a70d2b-600e-4ca5-b17e-d171d06fe974" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.813461] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: SUCCESS [ 830.813716] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.813873] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.814261] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.814410] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.814532] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.814589] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.814745] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.814858] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.814957] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.317937] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.778623] env[70764]: INFO networking_nsxv3.common.synchronization [req-76b1b035-7818-4ff2-917d-d261b0ec4209 req-07f7a92f-c298-4fb6-be48-0ee107eb36e2 tempest-ListServerFiltersTestJSON-1936062786 tempest-ListServerFiltersTestJSON-1936062786-project-member] Enqueued Resource ID: 9e245eb8-32e9-4599-974c-039ad69ab827 with Priority: HIGHEST for action security_group_members [ 831.779634] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e245eb8-32e9-4599-974c-039ad69ab827 with Priority: HIGHEST for action security_group_members [ 831.779852] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e245eb8-32e9-4599-974c-039ad69ab827 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.780054] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.780185] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.780634] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.783862] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.783862] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.783862] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.783862] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.783862] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.783862] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e245eb8-32e9-4599-974c-039ad69ab827',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.820948] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.286203] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.286549] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.286549] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.286794] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.286794] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.287639] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.287639] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.287639] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.287639] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.287639] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.287639] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e245eb8-32e9-4599-974c-039ad69ab827 already deleted. [ 832.287639] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.326066] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.326286] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.326418] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.326620] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.326769] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.326841] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8f5efec-a14e-4be6-8add-7b35a995c982 is going to be updated. [ 832.347295] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-967 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.347490] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-967" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.347624] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-967" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.348097] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-967" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.348288] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.348606] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.348606] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.349185] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.349185] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.349454] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 832.349592] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 832.349711] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 832.349831] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 832.349944] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 832.350080] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 832.350237] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 832.366141] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.366327] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.366377] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.366595] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.366770] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.372955] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 832.373152] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 832.373316] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 832.373520] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-967" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.373856] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-39d66532-b595-4981-aa90-d3c7add1b580 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.374119] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-39d66532-b595-4981-aa90-d3c7add1b580" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.374289] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-39d66532-b595-4981-aa90-d3c7add1b580" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.374665] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-39d66532-b595-4981-aa90-d3c7add1b580" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.374831] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39d66532-b595-4981-aa90-d3c7add1b580',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.384559] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: IN_PROGRESS for 2s [ 832.877552] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.877552] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.877552] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.878317] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.878317] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.878317] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 39d66532-b595-4981-aa90-d3c7add1b580 not found, creating... [ 832.878513] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.878703] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.878826] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.879985] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.879985] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.879985] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.879985] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.879985] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.879985] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.883065] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.883065] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 39d66532-b595-4981-aa90-d3c7add1b580 is going to be created. [ 832.903111] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.903111] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.903111] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.903324] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.903363] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.903588] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-39d66532-b595-4981-aa90-d3c7add1b580" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.733539] env[70764]: INFO networking_nsxv3.common.synchronization [None req-c05795a2-f868-4e1a-9e63-6093e0e1b50b None None] Enqueued Resource ID: 404d9206-10fa-4573-a9ba-a0e8dbf67f6a with Priority: HIGHEST for action port [ 833.733843] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 404d9206-10fa-4573-a9ba-a0e8dbf67f6a with Priority: HIGHEST for action port [ 833.734910] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-404d9206-10fa-4573-a9ba-a0e8dbf67f6a taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.736022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-404d9206-10fa-4573-a9ba-a0e8dbf67f6a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.736022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-404d9206-10fa-4573-a9ba-a0e8dbf67f6a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.736367] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-404d9206-10fa-4573-a9ba-a0e8dbf67f6a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.736482] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('404d9206-10fa-4573-a9ba-a0e8dbf67f6a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.930865] env[70764]: INFO networking_nsxv3.common.synchronization [req-76b1b035-7818-4ff2-917d-d261b0ec4209 req-43a3ae67-072f-4ed2-b0cb-a5b93b770369 service nova] Enqueued Resource ID: 9e245eb8-32e9-4599-974c-039ad69ab827 with Priority: HIGHEST for action security_group_rules [ 833.931166] env[70764]: INFO networking_nsxv3.common.synchronization [req-76b1b035-7818-4ff2-917d-d261b0ec4209 req-43a3ae67-072f-4ed2-b0cb-a5b93b770369 service nova] Enqueued Resource ID: 9e245eb8-32e9-4599-974c-039ad69ab827 with Priority: HIGHEST for action security_group_members [ 833.931209] env[70764]: INFO networking_nsxv3.common.synchronization [req-76b1b035-7818-4ff2-917d-d261b0ec4209 req-43a3ae67-072f-4ed2-b0cb-a5b93b770369 service nova] Enqueued Resource ID: 39d66532-b595-4981-aa90-d3c7add1b580 with Priority: HIGHEST for action port [ 833.932224] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e245eb8-32e9-4599-974c-039ad69ab827 with Priority: HIGHEST for action security_group_rules [ 833.932224] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e245eb8-32e9-4599-974c-039ad69ab827 with Priority: HIGHEST for action security_group_members [ 833.932224] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39d66532-b595-4981-aa90-d3c7add1b580 with Priority: HIGHEST for action port [ 833.932511] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e245eb8-32e9-4599-974c-039ad69ab827 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.932511] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.932614] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.935904] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.935904] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e245eb8-32e9-4599-974c-039ad69ab827',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.935904] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e245eb8-32e9-4599-974c-039ad69ab827 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.935904] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.935904] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.935904] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.935904] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.935904] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.935904] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.935904] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.935904] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.935904] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e245eb8-32e9-4599-974c-039ad69ab827',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.936647] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-39d66532-b595-4981-aa90-d3c7add1b580 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.936647] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39d66532-b595-4981-aa90-d3c7add1b580" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.936647] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39d66532-b595-4981-aa90-d3c7add1b580" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.937082] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39d66532-b595-4981-aa90-d3c7add1b580" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.937082] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39d66532-b595-4981-aa90-d3c7add1b580',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.056426] env[70764]: INFO networking_nsxv3.common.synchronization [None req-e28af829-389b-44da-93e5-fae6831d956d tempest-ServerRescueNegativeTestJSON-1208111124 tempest-ServerRescueNegativeTestJSON-1208111124-project-member] Enqueued Resource ID: 1575c38c-2999-4e79-86e3-5e41e8eaa04a with Priority: HIGHEST for action security_group_rules [ 834.056981] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1575c38c-2999-4e79-86e3-5e41e8eaa04a with Priority: HIGHEST for action security_group_rules [ 834.059531] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1575c38c-2999-4e79-86e3-5e41e8eaa04a taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.059668] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1575c38c-2999-4e79-86e3-5e41e8eaa04a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.059738] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1575c38c-2999-4e79-86e3-5e41e8eaa04a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.059997] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1575c38c-2999-4e79-86e3-5e41e8eaa04a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.060119] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1575c38c-2999-4e79-86e3-5e41e8eaa04a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.168292] env[70764]: INFO networking_nsxv3.common.synchronization [None req-0cf68c00-28f9-4e2b-ae24-fd44e912413e tempest-ServerRescueNegativeTestJSON-1208111124 tempest-ServerRescueNegativeTestJSON-1208111124-project-member] Enqueued Resource ID: 1575c38c-2999-4e79-86e3-5e41e8eaa04a with Priority: HIGHEST for action security_group_rules [ 834.169903] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1575c38c-2999-4e79-86e3-5e41e8eaa04a with Priority: HIGHEST for action security_group_rules [ 834.169903] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1575c38c-2999-4e79-86e3-5e41e8eaa04a taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.169903] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1575c38c-2999-4e79-86e3-5e41e8eaa04a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.240876] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 404d9206-10fa-4573-a9ba-a0e8dbf67f6a [ 834.241158] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.241795] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.241795] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.241795] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.241795] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.241795] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:404d9206-10fa-4573-a9ba-a0e8dbf67f6a already deleted. [ 834.242060] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-404d9206-10fa-4573-a9ba-a0e8dbf67f6a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.394554] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: SUCCESS [ 834.394554] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.394715] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.395372] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.395372] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.395372] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.395372] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.396120] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.396120] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.396120] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.396120] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.438598] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e245eb8-32e9-4599-974c-039ad69ab827 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.438598] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.438727] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e245eb8-32e9-4599-974c-039ad69ab827',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.439611] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 39d66532-b595-4981-aa90-d3c7add1b580 with status ACTIVE [ 834.439802] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.441692] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.441692] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.441692] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.441692] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.441692] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.441692] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.441692] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.442371] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.442371] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.442371] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.442371] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.442371] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.442371] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.442711] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.442711] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 39d66532-b595-4981-aa90-d3c7add1b580 is going to be updated. [ 834.472079] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.472079] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.472079] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.472079] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.472079] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.472079] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39d66532-b595-4981-aa90-d3c7add1b580" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.585280] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.585280] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.585280] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.585280] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.585280] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.585280] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1575c38c-2999-4e79-86e3-5e41e8eaa04a already deleted. [ 834.585280] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1575c38c-2999-4e79-86e3-5e41e8eaa04a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.585280] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1575c38c-2999-4e79-86e3-5e41e8eaa04a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.585280] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1575c38c-2999-4e79-86e3-5e41e8eaa04a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.585280] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1575c38c-2999-4e79-86e3-5e41e8eaa04a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.899982] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.899982] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.899982] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.899982] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.899982] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.899982] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.899982] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.899982] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.899982] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.899982] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.899982] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.901382] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.901382] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.901382] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.901382] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.901382] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.901382] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.901382] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.901382] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.901382] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.901382] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.944378] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e245eb8-32e9-4599-974c-039ad69ab827',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.105424] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.105607] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.105684] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.105913] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.106010] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.106112] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1575c38c-2999-4e79-86e3-5e41e8eaa04a already deleted. [ 835.106197] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1575c38c-2999-4e79-86e3-5e41e8eaa04a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.408571] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f8f5efec-a14e-4be6-8add-7b35a995c982: rpc.has_security_group_logging(os_id): False [ 835.426807] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.427238] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.428070] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.428070] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.447927] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.448174] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.448286] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.448367] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.448570] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.448687] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.448931] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.449058] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.449121] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.449322] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.449564] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.449610] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.449707] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.449768] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.449923] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.450017] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.451121] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8f5efec-a14e-4be6-8add-7b35a995c982 is going to be updated. [ 835.452501] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.452662] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.452755] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.452965] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.453090] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.453207] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e245eb8-32e9-4599-974c-039ad69ab827 is going to be created. [ 835.478852] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.479041] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.479107] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.480016] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.480016] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.490763] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e245eb8-32e9-4599-974c-039ad69ab827 in Status: UNINITIALIZED for 2s [ 835.518632] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.518824] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.518893] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.519118] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.519359] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.533903] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: IN_PROGRESS for 2s [ 836.051395] env[70764]: INFO networking_nsxv3.common.synchronization [None req-15bdcca2-ac38-44a5-ae71-78218f3ea049 None None] Enqueued Resource ID: d8397cc0-8a45-49cd-a8c6-f062f07d1d76 with Priority: HIGHEST for action port [ 836.051999] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8397cc0-8a45-49cd-a8c6-f062f07d1d76 with Priority: HIGHEST for action port [ 836.053077] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8397cc0-8a45-49cd-a8c6-f062f07d1d76 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.053077] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8397cc0-8a45-49cd-a8c6-f062f07d1d76" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.053077] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8397cc0-8a45-49cd-a8c6-f062f07d1d76" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.053325] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8397cc0-8a45-49cd-a8c6-f062f07d1d76" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.053325] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8397cc0-8a45-49cd-a8c6-f062f07d1d76',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.555906] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d8397cc0-8a45-49cd-a8c6-f062f07d1d76 [ 836.556258] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.556476] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.556622] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.556944] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.557207] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.557288] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d8397cc0-8a45-49cd-a8c6-f062f07d1d76 already deleted. [ 836.557337] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8397cc0-8a45-49cd-a8c6-f062f07d1d76" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.503319] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e245eb8-32e9-4599-974c-039ad69ab827 in Status: SUCCESS [ 837.503669] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.503730] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.503939] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.504140] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.504261] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.504320] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.504503] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.504596] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.504684] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.504773] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9e245eb8-32e9-4599-974c-039ad69ab827',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.553228] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: SUCCESS [ 837.553453] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.008288] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e245eb8-32e9-4599-974c-039ad69ab827 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.008288] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.008288] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.008601] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.008762] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.008912] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.009039] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.009209] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.009289] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.009342] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.009474] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e245eb8-32e9-4599-974c-039ad69ab827 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.009567] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.009628] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.009786] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.009957] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.010113] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.010162] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.010343] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.010413] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.010458] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.010569] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9e245eb8-32e9-4599-974c-039ad69ab827',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.513073] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9e245eb8-32e9-4599-974c-039ad69ab827: rpc.has_security_group_logging(os_id): False [ 838.533674] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.533674] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.533674] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.533674] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.533674] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.533674] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.533674] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.533674] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.533674] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.533674] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.533674] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.533674] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.533674] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.533674] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.533674] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.534438] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.537985] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.537985] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.537985] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.537985] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.537985] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e245eb8-32e9-4599-974c-039ad69ab827 is going to be created. [ 838.593483] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.593677] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.593734] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.593935] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.594177] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.604591] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e245eb8-32e9-4599-974c-039ad69ab827 in Status: IN_PROGRESS for 2s [ 839.142081] env[70764]: INFO networking_nsxv3.common.synchronization [req-0259aeb9-affc-4907-935f-13f25505599a req-16de9f47-d783-4408-8c4e-2551723d4665 tempest-ServersWithSpecificFlavorTestJSON-440557435 tempest-ServersWithSpecificFlavorTestJSON-440557435-project-member] Enqueued Resource ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 with Priority: HIGHEST for action security_group_members [ 839.142663] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 with Priority: HIGHEST for action security_group_members [ 839.143672] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-380030c5-e260-46fb-aa7e-5000c5bc9507 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.144144] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.146432] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.146432] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.146432] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.146432] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.146432] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.146432] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.146432] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.146432] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('380030c5-e260-46fb-aa7e-5000c5bc9507',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.446746] env[70764]: INFO networking_nsxv3.common.synchronization [req-70e4c076-7a35-4606-bd7d-d3a44308c9c6 req-cd96bcb8-a422-41f3-8234-a038126831c1 tempest-ListServerFiltersTestJSON-1936062786 tempest-ListServerFiltersTestJSON-1936062786-project-member] Enqueued Resource ID: 9e245eb8-32e9-4599-974c-039ad69ab827 with Priority: HIGHEST for action security_group_members [ 839.449486] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e245eb8-32e9-4599-974c-039ad69ab827 with Priority: HIGHEST for action security_group_members [ 839.450385] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e245eb8-32e9-4599-974c-039ad69ab827 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.450617] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.450724] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.450948] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.451174] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.451317] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.451410] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.451570] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.451648] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.451750] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e245eb8-32e9-4599-974c-039ad69ab827',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.649764] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.649764] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.649764] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.649764] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.678136] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.678136] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.678136] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.678136] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.678136] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.678136] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.678136] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 is going to be updated. [ 839.709595] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.709595] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.709827] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.710124] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.710196] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.723772] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 in Status: IN_PROGRESS for 2s [ 839.957280] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e245eb8-32e9-4599-974c-039ad69ab827',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.959699] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-967 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.959957] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-967" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.960037] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-967" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.960338] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-967" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.961229] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.961574] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.961997] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.962098] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.962259] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.962454] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 839.962598] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 839.962731] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 839.962842] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 839.962996] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 839.963091] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 839.963229] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 839.982962] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 839.983150] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 839.983295] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 839.983554] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-967" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.983912] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-2dbe8b24-9ef4-4ec1-b114-7b30be12d1b7 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.984102] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-2dbe8b24-9ef4-4ec1-b114-7b30be12d1b7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.984223] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-2dbe8b24-9ef4-4ec1-b114-7b30be12d1b7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.984604] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-2dbe8b24-9ef4-4ec1-b114-7b30be12d1b7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.984680] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2dbe8b24-9ef4-4ec1-b114-7b30be12d1b7',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.396156] env[70764]: INFO networking_nsxv3.common.synchronization [req-aae43d25-1f56-4899-8e9b-d9465f66806e req-5ff572ea-9e05-4dab-bfc8-7cf97d211404 tempest-ImagesTestJSON-1647743380 tempest-ImagesTestJSON-1647743380-project-member] Enqueued Resource ID: 4580d502-1d18-4681-96a4-28ac4e291d69 with Priority: HIGHEST for action security_group_members [ 840.396156] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4580d502-1d18-4681-96a4-28ac4e291d69 with Priority: HIGHEST for action security_group_members [ 840.396156] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4580d502-1d18-4681-96a4-28ac4e291d69 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.396156] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.396156] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.396156] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.396156] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.396156] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.396156] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.396156] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.396156] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.396952] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4580d502-1d18-4681-96a4-28ac4e291d69',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.465216] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e245eb8-32e9-4599-974c-039ad69ab827',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.487501] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.487723] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.487849] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.488158] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.488307] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.488460] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 2dbe8b24-9ef4-4ec1-b114-7b30be12d1b7 not found, creating... [ 840.488725] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.488877] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.488993] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.489226] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.489360] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.489639] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.489812] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.489930] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.490220] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.490359] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.490797] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 2dbe8b24-9ef4-4ec1-b114-7b30be12d1b7 is going to be created. [ 840.510029] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.510188] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.510230] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.510654] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.510902] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.511178] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-2dbe8b24-9ef4-4ec1-b114-7b30be12d1b7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.618204] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e245eb8-32e9-4599-974c-039ad69ab827 in Status: SUCCESS [ 840.618442] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.900755] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.901027] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.901027] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.901449] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.901449] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.901568] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.901675] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.901738] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.901893] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.901968] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.902061] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4580d502-1d18-4681-96a4-28ac4e291d69 is going to be updated. [ 840.928568] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.928676] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.928733] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.928944] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.929113] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.937312] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4580d502-1d18-4681-96a4-28ac4e291d69 in Status: IN_PROGRESS for 2s [ 840.967986] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.968178] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.968252] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.968560] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.968671] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.968776] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e245eb8-32e9-4599-974c-039ad69ab827 is going to be updated. [ 840.997608] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.997793] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.998024] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.998281] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.998433] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.008029] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e245eb8-32e9-4599-974c-039ad69ab827 in Status: IN_PROGRESS for 2s [ 841.162217] env[70764]: INFO networking_nsxv3.common.synchronization [None req-5abc4df5-15ad-44a9-8592-2fad9e50d12e None None] Enqueued Resource ID: 2acaf0ca-2a65-4963-bf2c-c3d098154a5a with Priority: HIGHEST for action port [ 841.162217] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2acaf0ca-2a65-4963-bf2c-c3d098154a5a with Priority: HIGHEST for action port [ 841.162217] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-2acaf0ca-2a65-4963-bf2c-c3d098154a5a taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.162217] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2acaf0ca-2a65-4963-bf2c-c3d098154a5a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.162217] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2acaf0ca-2a65-4963-bf2c-c3d098154a5a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.162217] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2acaf0ca-2a65-4963-bf2c-c3d098154a5a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.162217] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2acaf0ca-2a65-4963-bf2c-c3d098154a5a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.594247] env[70764]: INFO networking_nsxv3.common.synchronization [req-70e4c076-7a35-4606-bd7d-d3a44308c9c6 req-08397501-c27d-4355-babd-cd32f9fbbb63 service nova] Enqueued Resource ID: 9e245eb8-32e9-4599-974c-039ad69ab827 with Priority: HIGHEST for action security_group_rules [ 841.594355] env[70764]: INFO networking_nsxv3.common.synchronization [req-70e4c076-7a35-4606-bd7d-d3a44308c9c6 req-08397501-c27d-4355-babd-cd32f9fbbb63 service nova] Enqueued Resource ID: 9e245eb8-32e9-4599-974c-039ad69ab827 with Priority: HIGHEST for action security_group_members [ 841.594492] env[70764]: INFO networking_nsxv3.common.synchronization [req-70e4c076-7a35-4606-bd7d-d3a44308c9c6 req-08397501-c27d-4355-babd-cd32f9fbbb63 service nova] Enqueued Resource ID: 2dbe8b24-9ef4-4ec1-b114-7b30be12d1b7 with Priority: HIGHEST for action port [ 841.595116] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e245eb8-32e9-4599-974c-039ad69ab827 with Priority: HIGHEST for action security_group_rules [ 841.595263] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e245eb8-32e9-4599-974c-039ad69ab827 with Priority: HIGHEST for action security_group_members [ 841.595359] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dbe8b24-9ef4-4ec1-b114-7b30be12d1b7 with Priority: HIGHEST for action port [ 841.595647] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e245eb8-32e9-4599-974c-039ad69ab827 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.595775] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.595838] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.596056] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.596134] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e245eb8-32e9-4599-974c-039ad69ab827',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.596990] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e245eb8-32e9-4599-974c-039ad69ab827 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.597112] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.597308] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-2dbe8b24-9ef4-4ec1-b114-7b30be12d1b7 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.597423] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2dbe8b24-9ef4-4ec1-b114-7b30be12d1b7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.597463] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2dbe8b24-9ef4-4ec1-b114-7b30be12d1b7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.597631] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2dbe8b24-9ef4-4ec1-b114-7b30be12d1b7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.597749] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2dbe8b24-9ef4-4ec1-b114-7b30be12d1b7',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.668874] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2acaf0ca-2a65-4963-bf2c-c3d098154a5a [ 841.669173] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.669416] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.669481] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.669743] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.670365] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.670365] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2acaf0ca-2a65-4963-bf2c-c3d098154a5a already deleted. [ 841.670365] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2acaf0ca-2a65-4963-bf2c-c3d098154a5a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.739162] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 in Status: SUCCESS [ 841.739162] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 deletion is rescheduled due to dependency. [ 841.739162] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.837343] env[70764]: INFO networking_nsxv3.common.synchronization [req-641f1a73-60ce-4c9d-b196-a30570e62c72 req-ac10e8e6-eff6-448e-a02d-6a8627d7823a tempest-ServersTestJSON-88830314 tempest-ServersTestJSON-88830314-project-member] Enqueued Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_members [ 841.838184] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_members [ 841.838538] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.838702] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.838774] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.839010] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.839218] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.839347] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.839424] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.839587] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.839674] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.839768] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.101282] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e245eb8-32e9-4599-974c-039ad69ab827 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.101282] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.101967] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2dbe8b24-9ef4-4ec1-b114-7b30be12d1b7 with status ACTIVE [ 842.101967] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.101967] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.101967] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.101967] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.101967] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.102198] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.102246] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.102283] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.102412] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.102486] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.102662] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.102753] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.102815] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.102952] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.103094] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.103127] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2dbe8b24-9ef4-4ec1-b114-7b30be12d1b7 is going to be updated. [ 842.132378] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.132559] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.132721] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.132809] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.132965] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.136222] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2dbe8b24-9ef4-4ec1-b114-7b30be12d1b7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.342911] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.845392] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.855762] env[70764]: INFO networking_nsxv3.common.synchronization [req-3797aab4-c0f0-4c23-b36d-a7b9ed782abf req-2ecd4e3b-d216-48ef-92ce-9bea12432978 tempest-MigrationsAdminTest-1035321564 tempest-MigrationsAdminTest-1035321564-project-member] Enqueued Resource ID: 46f17c96-2a3a-415a-8b88-fe6fa64e3db5 with Priority: HIGHEST for action security_group_members [ 842.856524] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46f17c96-2a3a-415a-8b88-fe6fa64e3db5 with Priority: HIGHEST for action security_group_members [ 842.857568] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.857783] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.857783] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.858044] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.858238] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.858631] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.858631] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.858631] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.858793] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.858793] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46f17c96-2a3a-415a-8b88-fe6fa64e3db5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.947336] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4580d502-1d18-4681-96a4-28ac4e291d69 in Status: SUCCESS [ 842.947531] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4580d502-1d18-4681-96a4-28ac4e291d69 deletion is rescheduled due to dependency. [ 842.947647] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.019109] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e245eb8-32e9-4599-974c-039ad69ab827 in Status: SUCCESS [ 843.019109] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.019109] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.019109] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.019109] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.019109] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.019109] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.019109] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.019109] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.019109] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e245eb8-32e9-4599-974c-039ad69ab827',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.215509] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.215812] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.215812] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.216175] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.216284] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.218343] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-343 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.218512] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-343" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.218629] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-343" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.218855] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-343" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.219112] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.219285] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.219377] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.219578] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.219712] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.219908] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 843.220041] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 843.220159] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 843.220264] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 843.220370] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 843.220469] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 843.220661] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 843.240453] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 843.240453] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 843.240453] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 843.240694] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-343" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.240780] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-c3fb130c-6480-4ce5-8bc0-64b94679ac56 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.240945] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-c3fb130c-6480-4ce5-8bc0-64b94679ac56" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.241073] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-c3fb130c-6480-4ce5-8bc0-64b94679ac56" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.241960] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-c3fb130c-6480-4ce5-8bc0-64b94679ac56" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.241960] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3fb130c-6480-4ce5-8bc0-64b94679ac56',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.351833] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.352038] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.352106] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.352354] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.352484] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.352554] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8f5efec-a14e-4be6-8add-7b35a995c982 is going to be updated. [ 843.360748] env[70764]: INFO networking_nsxv3.common.synchronization [None req-40a46163-ed67-47b9-926c-c221d389c2ae None None] Enqueued Resource ID: d8ab08b4-af86-4df0-88ac-b23dd9fb1d1c with Priority: HIGHEST for action port [ 843.362031] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('46f17c96-2a3a-415a-8b88-fe6fa64e3db5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.363213] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8ab08b4-af86-4df0-88ac-b23dd9fb1d1c with Priority: HIGHEST for action port [ 843.363213] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8ab08b4-af86-4df0-88ac-b23dd9fb1d1c taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.363213] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8ab08b4-af86-4df0-88ac-b23dd9fb1d1c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.363213] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8ab08b4-af86-4df0-88ac-b23dd9fb1d1c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.363482] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8ab08b4-af86-4df0-88ac-b23dd9fb1d1c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.363525] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8ab08b4-af86-4df0-88ac-b23dd9fb1d1c',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.379890] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.384020] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.384020] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.384020] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.384020] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.388924] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: IN_PROGRESS for 2s [ 843.520406] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e245eb8-32e9-4599-974c-039ad69ab827',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.718575] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.744493] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.744795] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.744902] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.745267] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.745443] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.745635] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port c3fb130c-6480-4ce5-8bc0-64b94679ac56 not found, creating... [ 843.745905] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.746080] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.746658] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.746658] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.746658] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.746858] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.746941] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.747062] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.747266] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.747398] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.747534] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: c3fb130c-6480-4ce5-8bc0-64b94679ac56 is going to be created. [ 843.768562] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.768767] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.768889] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.769174] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.769435] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.769672] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-c3fb130c-6480-4ce5-8bc0-64b94679ac56" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.867743] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('46f17c96-2a3a-415a-8b88-fe6fa64e3db5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.867743] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d8ab08b4-af86-4df0-88ac-b23dd9fb1d1c [ 843.867743] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.867743] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.867743] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.867743] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.867743] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.867743] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d8ab08b4-af86-4df0-88ac-b23dd9fb1d1c already deleted. [ 843.867743] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8ab08b4-af86-4df0-88ac-b23dd9fb1d1c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.022645] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e245eb8-32e9-4599-974c-039ad69ab827',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.221218] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.370416] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.370642] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.370753] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.370992] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.371115] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.371229] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46f17c96-2a3a-415a-8b88-fe6fa64e3db5 is going to be updated. [ 844.399094] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.399259] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.399357] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.399564] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.399705] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.408479] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46f17c96-2a3a-415a-8b88-fe6fa64e3db5 in Status: IN_PROGRESS for 2s [ 844.524831] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.525180] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.525258] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.525476] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.525572] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.525678] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e245eb8-32e9-4599-974c-039ad69ab827 is going to be updated. [ 844.552537] env[70764]: INFO networking_nsxv3.common.synchronization [req-3797aab4-c0f0-4c23-b36d-a7b9ed782abf req-aeccefed-0974-4051-8c56-e71ea0673545 service nova] Enqueued Resource ID: 46f17c96-2a3a-415a-8b88-fe6fa64e3db5 with Priority: HIGHEST for action security_group_rules [ 844.552707] env[70764]: INFO networking_nsxv3.common.synchronization [req-3797aab4-c0f0-4c23-b36d-a7b9ed782abf req-aeccefed-0974-4051-8c56-e71ea0673545 service nova] Enqueued Resource ID: 46f17c96-2a3a-415a-8b88-fe6fa64e3db5 with Priority: HIGHEST for action security_group_members [ 844.552837] env[70764]: INFO networking_nsxv3.common.synchronization [req-3797aab4-c0f0-4c23-b36d-a7b9ed782abf req-aeccefed-0974-4051-8c56-e71ea0673545 service nova] Enqueued Resource ID: c3fb130c-6480-4ce5-8bc0-64b94679ac56 with Priority: HIGHEST for action port [ 844.553615] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46f17c96-2a3a-415a-8b88-fe6fa64e3db5 with Priority: HIGHEST for action security_group_rules [ 844.553870] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46f17c96-2a3a-415a-8b88-fe6fa64e3db5 with Priority: HIGHEST for action security_group_members [ 844.554023] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3fb130c-6480-4ce5-8bc0-64b94679ac56 with Priority: HIGHEST for action port [ 844.554382] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46f17c96-2a3a-415a-8b88-fe6fa64e3db5 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.554576] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.554674] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.554917] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.555057] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46f17c96-2a3a-415a-8b88-fe6fa64e3db5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.556291] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.556378] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.556589] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3fb130c-6480-4ce5-8bc0-64b94679ac56 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.556704] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3fb130c-6480-4ce5-8bc0-64b94679ac56" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.556784] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3fb130c-6480-4ce5-8bc0-64b94679ac56" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.557013] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3fb130c-6480-4ce5-8bc0-64b94679ac56" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.557101] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3fb130c-6480-4ce5-8bc0-64b94679ac56',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.559453] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.559617] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.559755] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.560015] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.561031] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.572677] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e245eb8-32e9-4599-974c-039ad69ab827 in Status: IN_PROGRESS for 2s [ 844.723707] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 844.723850] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 845.063572] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.063877] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.063877] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c3fb130c-6480-4ce5-8bc0-64b94679ac56 with status ACTIVE [ 845.064058] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.064160] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.064225] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.064398] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.064478] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.064661] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.064756] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.064833] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.064970] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.065069] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.065230] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.065332] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.065407] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.065520] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.065600] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.065659] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c3fb130c-6480-4ce5-8bc0-64b94679ac56 is going to be updated. [ 845.104541] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.104796] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.104976] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.105160] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.105355] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.105551] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3fb130c-6480-4ce5-8bc0-64b94679ac56" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.401609] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: SUCCESS [ 845.401857] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.441367] env[70764]: INFO networking_nsxv3.common.synchronization [req-c0f893fd-7404-4b4b-b932-c2505098e88b req-e0fd3a94-b716-4996-bfea-338fd39084e6 tempest-ListServerFiltersTestJSON-1936062786 tempest-ListServerFiltersTestJSON-1936062786-project-member] Enqueued Resource ID: 9e245eb8-32e9-4599-974c-039ad69ab827 with Priority: HIGHEST for action security_group_members [ 845.442431] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e245eb8-32e9-4599-974c-039ad69ab827 with Priority: HIGHEST for action security_group_members [ 845.444119] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e245eb8-32e9-4599-974c-039ad69ab827 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.444257] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.527785] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.527945] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.528052] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.528253] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.541889] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 845.542756] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.543540] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 845.567856] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.568030] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.568087] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.568272] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.574174] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.574661] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 845.574739] env[70764]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=70764) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 845.574826] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 845.610343] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.610343] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.610343] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.610343] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.610523] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.610929] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 845.665189] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.665391] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.665493] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.665757] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.666047] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.666324] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 845.738252] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.738399] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.738677] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.738677] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.738884] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.739131] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:35. [ 845.739224] env[70764]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'837be310-7b7c-4ed0-9877-3473fe63d929', 'c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c', '5e9c0048-237b-4cab-86e0-e56dce546daa', '48f2ee72-0aec-44b3-967c-055925852aa5', '380030c5-e260-46fb-aa7e-5000c5bc9507', 'fdc56614-fc86-49b5-b218-5339e368633a', '2a93825c-656b-4f3f-b946-3346edd746bf', 'f8f5efec-a14e-4be6-8add-7b35a995c982', 'b221064c-6962-44ea-989e-cf4546ea92ab', '9c661804-19d8-4b01-b7d8-b4d1885cc85f', 'c2d79e00-b6b0-41f3-96fb-49ab2b10751b', '9e245eb8-32e9-4599-974c-039ad69ab827', '053f53ee-d0a4-4067-829d-5dc886808f18', 'ffefe95f-97fb-4dd1-96fc-f444084d7691', '1f7d8ca5-61df-4ea2-b964-843e08d1b082', '8e62e528-352b-40bb-8f9d-c7bb50b75dff', '4402a532-4a5c-4a18-993a-a6249c552031', 'bb6f4eb6-36d0-4604-a204-4c47b22b4b54', 'f83113a5-bbfa-4011-9ddc-5d83a2a20121', 'a793445b-22a7-4c79-b31c-1beebe657659', '7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3', '4c1c605b-e422-421f-b86e-88a41bb1f9f4', '2fc2deb2-a89e-4527-9c6b-7c33727bc09c', 'c0695687-32e8-4e4a-a8c8-31e6c3709596', '6e903658-277d-417d-95d4-4fcc19078cba', '18c40e3b-51cd-431a-858a-22168889b4fd', '82966c1e-4055-4b82-8cb6-2f08a28fcec0', '4580d502-1d18-4681-96a4-28ac4e291d69', '7a2d7e17-bca4-4474-a2c6-152a257dcccd', '46f17c96-2a3a-415a-8b88-fe6fa64e3db5', 'f9c2bf07-cd28-4135-994d-30a9140bcc35', '527aa039-9b45-4682-bffb-ac71e24551a1', 'fc0ae2a8-a235-4d05-9f57-5fec83d37151', '4bfe698a-a7e8-4922-85ee-f21b719b7edb', 'dffe2468-a89e-4c09-9b45-a73f1d41f82e'} {{(pid=70764) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 845.739311] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 845.756607] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.756764] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.756873] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.758020] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.758020] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.758020] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 845.758020] env[70764]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=70764) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 845.758020] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 845.815146] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.815314] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.815383] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.815590] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.816365] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.816588] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 845.816668] env[70764]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70764) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 845.816739] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 845.816808] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 845.816886] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/35 resources of Type:Security Group Rules [ 845.816960] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 837be310-7b7c-4ed0-9877-3473fe63d929 with Priority: HIGH for action security_group_rules [ 845.817049] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c with Priority: HIGH for action security_group_rules [ 845.817220] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5e9c0048-237b-4cab-86e0-e56dce546daa with Priority: HIGH for action security_group_rules [ 845.817220] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 48f2ee72-0aec-44b3-967c-055925852aa5 with Priority: HIGH for action security_group_rules [ 845.817339] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 with Priority: HIGH for action security_group_rules [ 845.817339] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fdc56614-fc86-49b5-b218-5339e368633a with Priority: HIGH for action security_group_rules [ 845.817339] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2a93825c-656b-4f3f-b946-3346edd746bf with Priority: HIGH for action security_group_rules [ 845.817451] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGH for action security_group_rules [ 845.817451] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b221064c-6962-44ea-989e-cf4546ea92ab with Priority: HIGH for action security_group_rules [ 845.817521] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9c661804-19d8-4b01-b7d8-b4d1885cc85f with Priority: HIGH for action security_group_rules [ 845.817617] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b with Priority: HIGH for action security_group_rules [ 845.817617] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9e245eb8-32e9-4599-974c-039ad69ab827 with Priority: HIGH for action security_group_rules [ 845.817688] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 053f53ee-d0a4-4067-829d-5dc886808f18 with Priority: HIGH for action security_group_rules [ 845.817727] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ffefe95f-97fb-4dd1-96fc-f444084d7691 with Priority: HIGH for action security_group_rules [ 845.817793] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1f7d8ca5-61df-4ea2-b964-843e08d1b082 with Priority: HIGH for action security_group_rules [ 845.817854] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8e62e528-352b-40bb-8f9d-c7bb50b75dff with Priority: HIGH for action security_group_rules [ 845.817917] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4402a532-4a5c-4a18-993a-a6249c552031 with Priority: HIGH for action security_group_rules [ 845.817979] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bb6f4eb6-36d0-4604-a204-4c47b22b4b54 with Priority: HIGH for action security_group_rules [ 845.818051] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f83113a5-bbfa-4011-9ddc-5d83a2a20121 with Priority: HIGH for action security_group_rules [ 845.818119] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a793445b-22a7-4c79-b31c-1beebe657659 with Priority: HIGH for action security_group_rules [ 845.818269] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.928867] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-967 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.929949] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-967" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.929949] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-967" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.929949] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-967" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.929949] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.929949] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.930215] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.930375] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.930530] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.930741] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 845.930854] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 845.930959] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 845.931075] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 845.931181] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 845.931282] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 845.931439] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 845.950311] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 845.950311] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.016 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 845.950311] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 845.950311] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-967" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.950311] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-3e10acf1-8094-47a7-8db2-35726c349e54 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.950311] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-3e10acf1-8094-47a7-8db2-35726c349e54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.950311] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-3e10acf1-8094-47a7-8db2-35726c349e54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.950311] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-3e10acf1-8094-47a7-8db2-35726c349e54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.950311] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e10acf1-8094-47a7-8db2-35726c349e54',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.418248] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46f17c96-2a3a-415a-8b88-fe6fa64e3db5 in Status: SUCCESS [ 846.418687] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.418762] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.418992] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.419218] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.419382] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.419382] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.419541] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.419633] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.419757] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46f17c96-2a3a-415a-8b88-fe6fa64e3db5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.451013] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.454175] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.454175] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.454175] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.454175] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.454175] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 3e10acf1-8094-47a7-8db2-35726c349e54 not found, creating... [ 846.454175] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.454175] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.454175] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.454175] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.454175] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.454699] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.454699] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.454699] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.454699] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.454699] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.454699] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 3e10acf1-8094-47a7-8db2-35726c349e54 is going to be created. [ 846.476918] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.479023] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.479023] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.479023] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.479023] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.479023] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-3e10acf1-8094-47a7-8db2-35726c349e54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.596773] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e245eb8-32e9-4599-974c-039ad69ab827 in Status: SUCCESS [ 846.597025] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.597205] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.597419] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.597639] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.597792] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.598400] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.598400] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.598400] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.598400] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.598400] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9e245eb8-32e9-4599-974c-039ad69ab827',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.599904] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.600162] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.600338] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.600549] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.600549] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.600647] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.600726] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.600816] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e245eb8-32e9-4599-974c-039ad69ab827',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.623636] env[70764]: INFO networking_nsxv3.common.synchronization [req-b1ab5ce3-64ef-499f-8f79-9e2ebef8bb97 req-8ace9e9e-3017-465b-87ce-d2ec726a390f tempest-VolumesAssistedSnapshotsTest-491546016 tempest-VolumesAssistedSnapshotsTest-491546016-project-member] Enqueued Resource ID: f83113a5-bbfa-4011-9ddc-5d83a2a20121 with Priority: HIGHEST for action security_group_members [ 846.624145] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f83113a5-bbfa-4011-9ddc-5d83a2a20121 with Priority: HIGHEST for action security_group_members [ 846.624288] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 837be310-7b7c-4ed0-9877-3473fe63d929 with Priority: HIGH for action security_group_rules [ 846.624400] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e9c0048-237b-4cab-86e0-e56dce546daa with Priority: HIGH for action security_group_rules [ 846.624496] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a93825c-656b-4f3f-b946-3346edd746bf with Priority: HIGH for action security_group_rules [ 846.624593] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f7d8ca5-61df-4ea2-b964-843e08d1b082 with Priority: HIGH for action security_group_rules [ 846.624683] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a793445b-22a7-4c79-b31c-1beebe657659 with Priority: HIGH for action security_group_rules [ 846.626183] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f83113a5-bbfa-4011-9ddc-5d83a2a20121 with Priority: HIGH for action security_group_rules [ 846.626342] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb6f4eb6-36d0-4604-a204-4c47b22b4b54 with Priority: HIGH for action security_group_rules [ 846.626461] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4402a532-4a5c-4a18-993a-a6249c552031 with Priority: HIGH for action security_group_rules [ 846.626563] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffefe95f-97fb-4dd1-96fc-f444084d7691 with Priority: HIGH for action security_group_rules [ 846.626658] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e62e528-352b-40bb-8f9d-c7bb50b75dff with Priority: HIGH for action security_group_rules [ 846.626752] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 053f53ee-d0a4-4067-829d-5dc886808f18 with Priority: HIGH for action security_group_rules [ 846.626843] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e245eb8-32e9-4599-974c-039ad69ab827 with Priority: HIGH for action security_group_rules [ 846.626936] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b with Priority: HIGH for action security_group_rules [ 846.627037] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c661804-19d8-4b01-b7d8-b4d1885cc85f with Priority: HIGH for action security_group_rules [ 846.627130] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b221064c-6962-44ea-989e-cf4546ea92ab with Priority: HIGH for action security_group_rules [ 846.627220] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdc56614-fc86-49b5-b218-5339e368633a with Priority: HIGH for action security_group_rules [ 846.627307] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGH for action security_group_rules [ 846.627422] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 with Priority: HIGH for action security_group_rules [ 846.627488] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c with Priority: HIGH for action security_group_rules [ 846.627702] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48f2ee72-0aec-44b3-967c-055925852aa5 with Priority: HIGH for action security_group_rules [ 846.629048] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f83113a5-bbfa-4011-9ddc-5d83a2a20121 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.629048] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f83113a5-bbfa-4011-9ddc-5d83a2a20121" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.629048] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f83113a5-bbfa-4011-9ddc-5d83a2a20121" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.629048] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f83113a5-bbfa-4011-9ddc-5d83a2a20121" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.629048] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.629048] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.629048] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.629425] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.629425] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.629425] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f83113a5-bbfa-4011-9ddc-5d83a2a20121',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.630416] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-837be310-7b7c-4ed0-9877-3473fe63d929 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.630416] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-837be310-7b7c-4ed0-9877-3473fe63d929" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.630416] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-837be310-7b7c-4ed0-9877-3473fe63d929" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.631163] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-837be310-7b7c-4ed0-9877-3473fe63d929" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.631163] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('837be310-7b7c-4ed0-9877-3473fe63d929',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.631756] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e9c0048-237b-4cab-86e0-e56dce546daa taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.632733] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.632733] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.632733] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.632733] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e9c0048-237b-4cab-86e0-e56dce546daa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.633368] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a93825c-656b-4f3f-b946-3346edd746bf taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.633368] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.633368] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.633368] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.633560] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a93825c-656b-4f3f-b946-3346edd746bf',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.635847] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f7d8ca5-61df-4ea2-b964-843e08d1b082 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.635957] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.636056] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.636214] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.636290] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f7d8ca5-61df-4ea2-b964-843e08d1b082',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.637311] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a793445b-22a7-4c79-b31c-1beebe657659 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.637420] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.637490] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.637639] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.637712] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a793445b-22a7-4c79-b31c-1beebe657659',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.638994] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f83113a5-bbfa-4011-9ddc-5d83a2a20121 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.639114] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f83113a5-bbfa-4011-9ddc-5d83a2a20121" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.639192] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f83113a5-bbfa-4011-9ddc-5d83a2a20121" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.639329] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f83113a5-bbfa-4011-9ddc-5d83a2a20121" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.639448] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f83113a5-bbfa-4011-9ddc-5d83a2a20121',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.640439] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb6f4eb6-36d0-4604-a204-4c47b22b4b54 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.640555] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb6f4eb6-36d0-4604-a204-4c47b22b4b54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.640623] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb6f4eb6-36d0-4604-a204-4c47b22b4b54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.640794] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb6f4eb6-36d0-4604-a204-4c47b22b4b54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.640832] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb6f4eb6-36d0-4604-a204-4c47b22b4b54',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.641061] env[70764]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 846.641732] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4402a532-4a5c-4a18-993a-a6249c552031 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.641915] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4402a532-4a5c-4a18-993a-a6249c552031" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.642076] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4402a532-4a5c-4a18-993a-a6249c552031" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.642172] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4402a532-4a5c-4a18-993a-a6249c552031" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.642244] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4402a532-4a5c-4a18-993a-a6249c552031',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.643099] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ffefe95f-97fb-4dd1-96fc-f444084d7691 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.643246] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.643314] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.643464] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.643538] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ffefe95f-97fb-4dd1-96fc-f444084d7691',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.644329] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e62e528-352b-40bb-8f9d-c7bb50b75dff taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.644440] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e62e528-352b-40bb-8f9d-c7bb50b75dff" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.644505] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e62e528-352b-40bb-8f9d-c7bb50b75dff" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.644653] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e62e528-352b-40bb-8f9d-c7bb50b75dff" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.644726] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e62e528-352b-40bb-8f9d-c7bb50b75dff',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.645622] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-053f53ee-d0a4-4067-829d-5dc886808f18 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.645737] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.645809] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.645958] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.646038] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('053f53ee-d0a4-4067-829d-5dc886808f18',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.646833] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e245eb8-32e9-4599-974c-039ad69ab827 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.646913] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.647134] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c2d79e00-b6b0-41f3-96fb-49ab2b10751b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.647234] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.647297] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.647446] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.647522] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c2d79e00-b6b0-41f3-96fb-49ab2b10751b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.648336] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c661804-19d8-4b01-b7d8-b4d1885cc85f taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.648445] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.648512] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.648661] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.648732] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c661804-19d8-4b01-b7d8-b4d1885cc85f',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.649612] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b221064c-6962-44ea-989e-cf4546ea92ab taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.649722] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b221064c-6962-44ea-989e-cf4546ea92ab" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.649821] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b221064c-6962-44ea-989e-cf4546ea92ab" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.649925] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b221064c-6962-44ea-989e-cf4546ea92ab" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.649999] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b221064c-6962-44ea-989e-cf4546ea92ab',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.650791] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fdc56614-fc86-49b5-b218-5339e368633a taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.650940] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fdc56614-fc86-49b5-b218-5339e368633a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.651049] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fdc56614-fc86-49b5-b218-5339e368633a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.651209] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fdc56614-fc86-49b5-b218-5339e368633a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.651282] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fdc56614-fc86-49b5-b218-5339e368633a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.652107] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.652211] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.652276] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.652445] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.652523] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.653447] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-380030c5-e260-46fb-aa7e-5000c5bc9507 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.653567] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.653634] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.653785] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.653858] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('380030c5-e260-46fb-aa7e-5000c5bc9507',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.654083] env[70764]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 846.654735] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.654843] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.654921] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.655087] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.655162] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.655935] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48f2ee72-0aec-44b3-967c-055925852aa5 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.656058] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48f2ee72-0aec-44b3-967c-055925852aa5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.656124] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48f2ee72-0aec-44b3-967c-055925852aa5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.656272] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48f2ee72-0aec-44b3-967c-055925852aa5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.656344] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48f2ee72-0aec-44b3-967c-055925852aa5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.659545] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.659660] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.659728] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.659885] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.662079] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e9c0048-237b-4cab-86e0-e56dce546daa taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.662222] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.662291] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.662494] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.662671] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.662777] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.662850] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.662996] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.663093] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.663179] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.663266] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e9c0048-237b-4cab-86e0-e56dce546daa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.692747] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.692916] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.693070] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.693137] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.693355] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.693543] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.693543] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f83113a5-bbfa-4011-9ddc-5d83a2a20121 is going to be updated. [ 846.724767] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.724767] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.724767] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.725131] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.725274] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.736127] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f83113a5-bbfa-4011-9ddc-5d83a2a20121 in Status: IN_PROGRESS for 2s [ 846.925017] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('46f17c96-2a3a-415a-8b88-fe6fa64e3db5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.100687] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e245eb8-32e9-4599-974c-039ad69ab827 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.100832] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.102185] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e245eb8-32e9-4599-974c-039ad69ab827',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.161311] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-837be310-7b7c-4ed0-9877-3473fe63d929 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.161311] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-837be310-7b7c-4ed0-9877-3473fe63d929" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.161311] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-837be310-7b7c-4ed0-9877-3473fe63d929" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.161311] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-837be310-7b7c-4ed0-9877-3473fe63d929" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.161311] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.161311] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.161311] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.161311] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.161311] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.161311] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-837be310-7b7c-4ed0-9877-3473fe63d929" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.161311] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('837be310-7b7c-4ed0-9877-3473fe63d929',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.168468] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e9c0048-237b-4cab-86e0-e56dce546daa taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.168665] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.168779] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.169573] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.169573] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.169573] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.169573] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.169573] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.169901] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.169901] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.170062] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e9c0048-237b-4cab-86e0-e56dce546daa taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.170173] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.170231] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.170379] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.170552] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.170657] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.170727] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.170904] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.171039] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.171125] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.171255] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e9c0048-237b-4cab-86e0-e56dce546daa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.189493] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c661804-19d8-4b01-b7d8-b4d1885cc85f taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.189673] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.189746] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.190318] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.190318] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.190318] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.190318] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.190588] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.190588] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.190588] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.190696] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9c661804-19d8-4b01-b7d8-b4d1885cc85f',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.191838] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffefe95f-97fb-4dd1-96fc-f444084d7691 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.195035] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.195135] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.195374] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.199027] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.199027] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.199027] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.199027] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.199027] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.199027] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.199027] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ffefe95f-97fb-4dd1-96fc-f444084d7691',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.199027] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.199027] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.199027] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.199027] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.200475] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-b221064c-6962-44ea-989e-cf4546ea92ab taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.200621] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b221064c-6962-44ea-989e-cf4546ea92ab" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.200709] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b221064c-6962-44ea-989e-cf4546ea92ab" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.202211] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b221064c-6962-44ea-989e-cf4546ea92ab" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.202445] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.202562] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.202785] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.202972] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.203106] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.203218] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b221064c-6962-44ea-989e-cf4546ea92ab" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.203332] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b221064c-6962-44ea-989e-cf4546ea92ab',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.210359] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4402a532-4a5c-4a18-993a-a6249c552031 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.210604] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4402a532-4a5c-4a18-993a-a6249c552031" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.210724] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4402a532-4a5c-4a18-993a-a6249c552031" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.210993] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4402a532-4a5c-4a18-993a-a6249c552031" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.211241] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.211401] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.211502] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.211829] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.211987] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.213062] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4402a532-4a5c-4a18-993a-a6249c552031" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.213686] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4402a532-4a5c-4a18-993a-a6249c552031',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.221619] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f7d8ca5-61df-4ea2-b964-843e08d1b082 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.221864] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.221976] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.222231] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.222719] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.222719] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.222719] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.222885] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.222885] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.222973] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.223313] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1f7d8ca5-61df-4ea2-b964-843e08d1b082',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.226335] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.226498] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.226589] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.227083] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.227083] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.227229] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.227229] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.227713] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.227850] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.227980] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.228159] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.236949] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffefe95f-97fb-4dd1-96fc-f444084d7691 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.237170] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.237265] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.237550] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.237794] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.237945] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.238044] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.238231] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.238353] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.238464] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.238642] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffefe95f-97fb-4dd1-96fc-f444084d7691 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.238764] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.238845] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.239026] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.239204] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.239346] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.239710] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.239910] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.240032] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.240153] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.240420] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ffefe95f-97fb-4dd1-96fc-f444084d7691',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.245361] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b221064c-6962-44ea-989e-cf4546ea92ab',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.250229] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ffefe95f-97fb-4dd1-96fc-f444084d7691: rpc.has_security_group_logging(os_id): False [ 847.288633] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.288787] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.289652] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.289770] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.296678] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.296678] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.297101] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.297208] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.297891] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.298108] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.300650] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.300750] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.301355] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.301589] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.302342] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.302508] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.303838] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.303838] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.305665] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.305665] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a93825c-656b-4f3f-b946-3346edd746bf is going to be deleted. [ 847.306595] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.306595] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.308174] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.308174] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.310124] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.310239] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.326375] env[70764]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 847.327243] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.327610] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 053f53ee-d0a4-4067-829d-5dc886808f18 is going to be deleted. [ 847.330853] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.330853] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.359379] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.359515] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48f2ee72-0aec-44b3-967c-055925852aa5 is going to be deleted. [ 847.360456] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.360672] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.366899] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.367060] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.394077] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.394257] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fdc56614-fc86-49b5-b218-5339e368633a is going to be deleted. [ 847.395488] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.395488] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.421281] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.421607] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.424197] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.424322] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c2d79e00-b6b0-41f3-96fb-49ab2b10751b is going to be deleted. [ 847.425530] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('46f17c96-2a3a-415a-8b88-fe6fa64e3db5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.426861] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.426861] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.430447] env[70764]: INFO networking_nsxv3.common.synchronization [req-c0f893fd-7404-4b4b-b932-c2505098e88b req-cb1b3179-f9d5-43a0-b718-d9bd6962dd80 service nova] Enqueued Resource ID: 9e245eb8-32e9-4599-974c-039ad69ab827 with Priority: HIGHEST for action security_group_rules [ 847.430713] env[70764]: INFO networking_nsxv3.common.synchronization [req-c0f893fd-7404-4b4b-b932-c2505098e88b req-cb1b3179-f9d5-43a0-b718-d9bd6962dd80 service nova] Enqueued Resource ID: 9e245eb8-32e9-4599-974c-039ad69ab827 with Priority: HIGHEST for action security_group_members [ 847.430935] env[70764]: INFO networking_nsxv3.common.synchronization [req-c0f893fd-7404-4b4b-b932-c2505098e88b req-cb1b3179-f9d5-43a0-b718-d9bd6962dd80 service nova] Enqueued Resource ID: 3e10acf1-8094-47a7-8db2-35726c349e54 with Priority: HIGHEST for action port [ 847.431491] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e245eb8-32e9-4599-974c-039ad69ab827 with Priority: HIGHEST for action security_group_rules [ 847.431602] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e245eb8-32e9-4599-974c-039ad69ab827 with Priority: HIGHEST for action security_group_members [ 847.431719] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e10acf1-8094-47a7-8db2-35726c349e54 with Priority: HIGHEST for action port [ 847.432390] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e245eb8-32e9-4599-974c-039ad69ab827 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.432581] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.433057] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e245eb8-32e9-4599-974c-039ad69ab827 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.433057] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.434504] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e10acf1-8094-47a7-8db2-35726c349e54 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.434504] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e10acf1-8094-47a7-8db2-35726c349e54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.434504] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e10acf1-8094-47a7-8db2-35726c349e54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.434504] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e10acf1-8094-47a7-8db2-35726c349e54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.434504] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e10acf1-8094-47a7-8db2-35726c349e54',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.450715] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.450916] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb6f4eb6-36d0-4604-a204-4c47b22b4b54 is going to be deleted. [ 847.451897] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.452144] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.543588] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.543747] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.545083] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.545209] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 is going to be deleted. [ 847.546072] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.546330] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.576261] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.576388] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.588136] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.588302] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c is going to be deleted. [ 847.589262] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.589456] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.592807] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.592807] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.593722] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.593722] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.604343] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e245eb8-32e9-4599-974c-039ad69ab827',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.627483] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.627620] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e62e528-352b-40bb-8f9d-c7bb50b75dff is going to be deleted. [ 847.628603] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.628828] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.628943] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.629080] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f83113a5-bbfa-4011-9ddc-5d83a2a20121 is going to be deleted. [ 847.630143] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.630350] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.647289] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.647412] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.667148] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('837be310-7b7c-4ed0-9877-3473fe63d929',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.673783] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e9c0048-237b-4cab-86e0-e56dce546daa: rpc.has_security_group_logging(os_id): False [ 847.693978] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.694135] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.698920] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.699027] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.699097] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.699160] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.699355] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.699444] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.699650] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.699754] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.699818] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.699973] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.700061] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.700249] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.700331] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.700393] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.700529] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.700604] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.700693] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ffefe95f-97fb-4dd1-96fc-f444084d7691 is going to be updated. [ 847.701852] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.701958] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.703528] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9c661804-19d8-4b01-b7d8-b4d1885cc85f',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.705006] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.705117] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.716191] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4402a532-4a5c-4a18-993a-a6249c552031',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.727678] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f7d8ca5-61df-4ea2-b964-843e08d1b082 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.727678] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.727678] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.727678] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.727678] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.727678] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.727678] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.727678] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.727678] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.727678] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.727678] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f7d8ca5-61df-4ea2-b964-843e08d1b082 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.727678] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.727678] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.727678] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.728318] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.728318] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.728318] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.728318] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.728318] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.728318] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.728318] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1f7d8ca5-61df-4ea2-b964-843e08d1b082',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.729720] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.729840] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.729840] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.729956] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.730117] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.730227] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.730264] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.730406] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.730484] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.730564] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.730756] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.730848] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.730980] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.731066] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.731189] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.731289] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.731409] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.731559] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.731633] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.731715] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.731800] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.751577] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b221064c-6962-44ea-989e-cf4546ea92ab: rpc.has_security_group_logging(os_id): False [ 847.764721] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.764856] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a793445b-22a7-4c79-b31c-1beebe657659 is going to be deleted. [ 847.765766] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.766419] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.766419] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.766419] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-053f53ee-d0a4-4067-829d-5dc886808f18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.766419] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.766841] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.766841] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.766918] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c2d79e00-b6b0-41f3-96fb-49ab2b10751b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.767394] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.767552] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.767614] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.767728] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb6f4eb6-36d0-4604-a204-4c47b22b4b54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.767846] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.767990] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.768077] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.768180] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fdc56614-fc86-49b5-b218-5339e368633a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.768320] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.768462] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.768569] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.768637] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48f2ee72-0aec-44b3-967c-055925852aa5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.768753] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.768890] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.768965] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.769084] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.769205] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.769342] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.769409] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.769585] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5cfda4f-d1e3-430e-9a28-9bc8e5c3b50c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.769664] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.769881] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.769949] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.770231] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.770231] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.770528] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.778045] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.778203] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.827349] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.827567] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.853089] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.853275] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.867534] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.867826] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.867954] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.868033] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.868252] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.868334] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.868476] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.868569] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.868624] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.868761] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.868834] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.869016] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.869104] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.869156] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.869287] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.869380] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.869472] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e9c0048-237b-4cab-86e0-e56dce546daa is going to be updated. [ 847.870508] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.870665] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.870748] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.870865] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e62e528-352b-40bb-8f9d-c7bb50b75dff" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.871323] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.871501] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.897464] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.897619] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.928806] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.929023] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.929319] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.929576] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.929677] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.929781] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46f17c96-2a3a-415a-8b88-fe6fa64e3db5 is going to be updated. [ 847.936888] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3e10acf1-8094-47a7-8db2-35726c349e54 with status ACTIVE [ 847.937096] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.937395] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.937395] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.937513] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.937551] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.937730] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.937829] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.937890] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.938042] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.938118] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.938295] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.938389] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.938451] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.938585] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.938657] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.938741] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3e10acf1-8094-47a7-8db2-35726c349e54 is going to be updated. [ 847.952556] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.952556] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.966655] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.966655] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.966655] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.966655] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.966655] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.966655] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.966655] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b221064c-6962-44ea-989e-cf4546ea92ab is going to be updated. [ 847.966655] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.966655] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.966655] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.966655] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f83113a5-bbfa-4011-9ddc-5d83a2a20121" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.966655] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.966655] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.967487] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.969192] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.969499] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.969690] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.970111] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a793445b-22a7-4c79-b31c-1beebe657659" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.006800] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.006800] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.006800] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.006987] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.010523] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.010523] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e10acf1-8094-47a7-8db2-35726c349e54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.026349] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.026511] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.026566] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.026779] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.026925] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.028878] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ffefe95f-97fb-4dd1-96fc-f444084d7691 in Status: IN_PROGRESS for 2s [ 848.036932] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46f17c96-2a3a-415a-8b88-fe6fa64e3db5 in Status: IN_PROGRESS for 2s [ 848.075658] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.075796] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.075864] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.076101] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.076228] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.084493] env[70764]: INFO networking_nsxv3.common.synchronization [req-20b4307d-6425-46c7-a450-7c0b1fa170b8 req-35777437-6246-45a1-8570-63f243f1bc43 tempest-AttachVolumeNegativeTest-232785497 tempest-AttachVolumeNegativeTest-232785497-project-member] Enqueued Resource ID: 0e0a8aca-d575-4597-b049-0d3d263dac47 with Priority: HIGHEST for action security_group_members [ 848.085071] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e0a8aca-d575-4597-b049-0d3d263dac47 with Priority: HIGHEST for action security_group_members [ 848.085405] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e0a8aca-d575-4597-b049-0d3d263dac47 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.085572] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e0a8aca-d575-4597-b049-0d3d263dac47" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.085641] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e0a8aca-d575-4597-b049-0d3d263dac47" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.085886] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e0a8aca-d575-4597-b049-0d3d263dac47" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.086096] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.086230] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.086323] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.086504] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.086610] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.086721] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e0a8aca-d575-4597-b049-0d3d263dac47',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.098269] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.098339] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.098401] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.098605] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.098746] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.106742] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.106864] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.106864] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.107067] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.107186] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.107641] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e245eb8-32e9-4599-974c-039ad69ab827 is going to be updated. [ 848.110447] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e9c0048-237b-4cab-86e0-e56dce546daa in Status: IN_PROGRESS for 2s [ 848.128387] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b221064c-6962-44ea-989e-cf4546ea92ab in Status: IN_PROGRESS for 2s [ 848.163202] env[70764]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 848.163831] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.164033] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.164164] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.164413] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.164732] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.171272] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 837be310-7b7c-4ed0-9877-3473fe63d929: rpc.has_security_group_logging(os_id): False [ 848.178057] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e245eb8-32e9-4599-974c-039ad69ab827 in Status: IN_PROGRESS for 2s [ 848.207402] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9c661804-19d8-4b01-b7d8-b4d1885cc85f: rpc.has_security_group_logging(os_id): False [ 848.225127] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.225271] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.225340] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.225573] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.227539] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4402a532-4a5c-4a18-993a-a6249c552031: rpc.has_security_group_logging(os_id): False [ 848.230402] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1f7d8ca5-61df-4ea2-b964-843e08d1b082: rpc.has_security_group_logging(os_id): False [ 848.234293] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f8f5efec-a14e-4be6-8add-7b35a995c982: rpc.has_security_group_logging(os_id): False [ 848.251060] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.251225] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.252277] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.252435] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.253660] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.254044] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.254194] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.254295] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.254561] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.254726] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.254797] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 837be310-7b7c-4ed0-9877-3473fe63d929 is going to be updated. [ 848.256115] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.256352] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.277665] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.277665] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.284990] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.284990] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.294386] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.294623] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.294740] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.294806] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.295012] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.295099] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.295292] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.295391] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.295447] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.295596] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.295668] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.295862] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.295943] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.296026] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.296155] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.296228] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.296319] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f7d8ca5-61df-4ea2-b964-843e08d1b082 is going to be updated. [ 848.297340] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.299508] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.340222] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.340542] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.340642] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.340707] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.340890] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.340971] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.341074] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4402a532-4a5c-4a18-993a-a6249c552031 is going to be updated. [ 848.342277] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.342497] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.389262] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.389396] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.391051] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.391304] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.391462] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.391534] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.391720] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.391800] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.391993] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.392098] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.392476] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.392476] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.392476] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.392647] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.392647] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.392758] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.392816] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.392874] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.392966] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8f5efec-a14e-4be6-8add-7b35a995c982 is going to be updated. [ 848.393993] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.394339] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.395862] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.395956] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.418297] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.418734] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.418734] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.418734] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.418942] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.419012] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.419109] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c661804-19d8-4b01-b7d8-b4d1885cc85f is going to be updated. [ 848.420108] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.420276] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.420412] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.421697] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.421973] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.421973] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.449399] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 837be310-7b7c-4ed0-9877-3473fe63d929 in Status: IN_PROGRESS for 2s [ 848.450753] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f7d8ca5-61df-4ea2-b964-843e08d1b082 in Status: IN_PROGRESS for 2s [ 848.462923] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.463166] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.463166] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.463383] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.463514] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.477831] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4402a532-4a5c-4a18-993a-a6249c552031 in Status: IN_PROGRESS for 2s [ 848.532516] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.532787] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.532787] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.532916] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.533192] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.535124] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.535350] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.535350] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.535562] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.535649] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.565534] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c661804-19d8-4b01-b7d8-b4d1885cc85f in Status: IN_PROGRESS for 2s [ 848.566336] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: IN_PROGRESS for 2s [ 848.595010] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.595204] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.595248] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.595466] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.595558] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.595761] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.595866] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.595931] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.596084] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.596156] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.596243] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e0a8aca-d575-4597-b049-0d3d263dac47 already deleted. [ 848.596323] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e0a8aca-d575-4597-b049-0d3d263dac47" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.746370] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f83113a5-bbfa-4011-9ddc-5d83a2a20121 in Status: SUCCESS [ 848.746553] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f83113a5-bbfa-4011-9ddc-5d83a2a20121 deletion is rescheduled due to dependency. [ 848.746667] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f83113a5-bbfa-4011-9ddc-5d83a2a20121" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.937492] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-985 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.937841] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-985" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.938195] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-985" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.938639] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-985" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.939073] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.939346] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.939562] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.939910] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.940155] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.940480] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 848.940686] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 848.940874] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 848.941094] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 848.941302] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 848.941495] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 848.941715] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 848.960368] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 848.960682] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 848.960948] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 848.961286] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-985" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.961805] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-23d28c9a-94a2-4564-8962-f91d7ea1600f taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.962129] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-23d28c9a-94a2-4564-8962-f91d7ea1600f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.962384] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-23d28c9a-94a2-4564-8962-f91d7ea1600f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.962868] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-23d28c9a-94a2-4564-8962-f91d7ea1600f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.963145] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23d28c9a-94a2-4564-8962-f91d7ea1600f',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.466645] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.467099] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.467225] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.467623] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.467742] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.467921] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 23d28c9a-94a2-4564-8962-f91d7ea1600f not found, creating... [ 849.468248] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.468445] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.468636] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.468976] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.469154] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.469596] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.469747] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.469881] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.470214] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.470377] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.470590] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 23d28c9a-94a2-4564-8962-f91d7ea1600f is going to be created. [ 849.490523] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.490741] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.490903] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.491297] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.491625] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.491915] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-23d28c9a-94a2-4564-8962-f91d7ea1600f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.043536] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ffefe95f-97fb-4dd1-96fc-f444084d7691 in Status: SUCCESS [ 850.044098] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.044867] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46f17c96-2a3a-415a-8b88-fe6fa64e3db5 in Status: SUCCESS [ 850.045106] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.045287] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.045524] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.045743] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.046156] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.046256] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.046452] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.046568] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.046683] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.046807] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('46f17c96-2a3a-415a-8b88-fe6fa64e3db5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.133185] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e9c0048-237b-4cab-86e0-e56dce546daa in Status: SUCCESS [ 850.133185] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.136329] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b221064c-6962-44ea-989e-cf4546ea92ab in Status: SUCCESS [ 850.137071] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b221064c-6962-44ea-989e-cf4546ea92ab" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.188437] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e245eb8-32e9-4599-974c-039ad69ab827 in Status: SUCCESS [ 850.188437] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.188437] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.188437] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.188437] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.188437] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.188437] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.188437] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.188437] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.188437] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.188437] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e245eb8-32e9-4599-974c-039ad69ab827 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.188437] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.188437] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.188437] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.188437] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.188437] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.188437] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.188437] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.188437] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.189163] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.189542] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9e245eb8-32e9-4599-974c-039ad69ab827',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.190808] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.191121] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.191388] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.196100] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.196100] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.196100] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.196100] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.196100] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e245eb8-32e9-4599-974c-039ad69ab827',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.466955] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 837be310-7b7c-4ed0-9877-3473fe63d929 in Status: SUCCESS [ 850.468131] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-837be310-7b7c-4ed0-9877-3473fe63d929" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.472205] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f7d8ca5-61df-4ea2-b964-843e08d1b082 in Status: SUCCESS [ 850.472396] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.489819] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4402a532-4a5c-4a18-993a-a6249c552031 in Status: SUCCESS [ 850.490048] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4402a532-4a5c-4a18-993a-a6249c552031" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.549055] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.549055] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.549055] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.549359] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.549510] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.549627] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.549699] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.549879] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.549978] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.550378] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.550952] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.550952] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.550952] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.551224] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.554278] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.554278] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.554278] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.554278] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.554278] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.554278] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.554278] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('46f17c96-2a3a-415a-8b88-fe6fa64e3db5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.580620] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c661804-19d8-4b01-b7d8-b4d1885cc85f in Status: SUCCESS [ 850.580858] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.584039] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: SUCCESS [ 850.584282] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.600419] env[70764]: INFO networking_nsxv3.common.synchronization [req-20b4307d-6425-46c7-a450-7c0b1fa170b8 req-5c10f948-7550-4c08-8be6-e99dd79b3245 service nova] Enqueued Resource ID: 0e0a8aca-d575-4597-b049-0d3d263dac47 with Priority: HIGHEST for action security_group_rules [ 850.600690] env[70764]: INFO networking_nsxv3.common.synchronization [req-20b4307d-6425-46c7-a450-7c0b1fa170b8 req-5c10f948-7550-4c08-8be6-e99dd79b3245 service nova] Enqueued Resource ID: 0e0a8aca-d575-4597-b049-0d3d263dac47 with Priority: HIGHEST for action security_group_members [ 850.600847] env[70764]: INFO networking_nsxv3.common.synchronization [req-20b4307d-6425-46c7-a450-7c0b1fa170b8 req-5c10f948-7550-4c08-8be6-e99dd79b3245 service nova] Enqueued Resource ID: 23d28c9a-94a2-4564-8962-f91d7ea1600f with Priority: HIGHEST for action port [ 850.601436] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e0a8aca-d575-4597-b049-0d3d263dac47 with Priority: HIGHEST for action security_group_rules [ 850.601575] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e0a8aca-d575-4597-b049-0d3d263dac47 with Priority: HIGHEST for action security_group_members [ 850.601674] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23d28c9a-94a2-4564-8962-f91d7ea1600f with Priority: HIGHEST for action port [ 850.602644] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e0a8aca-d575-4597-b049-0d3d263dac47 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.602799] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e0a8aca-d575-4597-b049-0d3d263dac47" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.602893] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e0a8aca-d575-4597-b049-0d3d263dac47" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.603097] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e0a8aca-d575-4597-b049-0d3d263dac47" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.603180] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e0a8aca-d575-4597-b049-0d3d263dac47',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.604058] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e0a8aca-d575-4597-b049-0d3d263dac47 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.604186] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e0a8aca-d575-4597-b049-0d3d263dac47" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.604253] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e0a8aca-d575-4597-b049-0d3d263dac47" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.604429] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e0a8aca-d575-4597-b049-0d3d263dac47" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.604587] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.604675] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.604737] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.604876] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.604959] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.605071] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e0a8aca-d575-4597-b049-0d3d263dac47',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.605944] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-23d28c9a-94a2-4564-8962-f91d7ea1600f taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.606076] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23d28c9a-94a2-4564-8962-f91d7ea1600f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.606172] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23d28c9a-94a2-4564-8962-f91d7ea1600f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.606293] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23d28c9a-94a2-4564-8962-f91d7ea1600f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.606410] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23d28c9a-94a2-4564-8962-f91d7ea1600f',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.698827] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9e245eb8-32e9-4599-974c-039ad69ab827: rpc.has_security_group_logging(os_id): False [ 850.699968] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e245eb8-32e9-4599-974c-039ad69ab827',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.716629] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.716792] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.716840] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.717110] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.736071] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.736071] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.736071] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.736071] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.736071] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.736071] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.736071] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.736071] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.736487] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.736623] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.736705] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.736905] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.737011] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.737075] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.737217] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.737293] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.737378] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e245eb8-32e9-4599-974c-039ad69ab827 is going to be updated. [ 850.799778] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.799778] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.799778] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.799778] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.799778] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.816207] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e245eb8-32e9-4599-974c-039ad69ab827 in Status: IN_PROGRESS for 2s [ 851.056838] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 46f17c96-2a3a-415a-8b88-fe6fa64e3db5: rpc.has_security_group_logging(os_id): False [ 851.074396] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.074638] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.074770] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.075112] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.100031] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.100296] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.100428] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.100497] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.100699] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.100783] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.100997] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.101108] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.101173] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.101324] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.101465] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.101611] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.101703] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.101764] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.101905] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.101981] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.102289] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46f17c96-2a3a-415a-8b88-fe6fa64e3db5 is going to be updated. [ 851.108370] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e0a8aca-d575-4597-b049-0d3d263dac47 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.108534] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e0a8aca-d575-4597-b049-0d3d263dac47" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.108652] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 23d28c9a-94a2-4564-8962-f91d7ea1600f with status ACTIVE [ 851.108835] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.108922] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.108962] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.109156] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.109241] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.109405] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.109503] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.109566] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.109709] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.109787] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.109963] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.110070] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.110132] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.110271] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.110345] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.110426] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 23d28c9a-94a2-4564-8962-f91d7ea1600f is going to be updated. [ 851.111550] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0e0a8aca-d575-4597-b049-0d3d263dac47',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.130510] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.130783] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.130783] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.130909] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.131080] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.131223] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23d28c9a-94a2-4564-8962-f91d7ea1600f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.178661] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.178817] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.178886] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.179106] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.179244] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.198302] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46f17c96-2a3a-415a-8b88-fe6fa64e3db5 in Status: IN_PROGRESS for 2s [ 851.203623] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e245eb8-32e9-4599-974c-039ad69ab827',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.614202] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0e0a8aca-d575-4597-b049-0d3d263dac47',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.709022] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.709022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.709022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.709022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.709022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.709022] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e245eb8-32e9-4599-974c-039ad69ab827 is going to be updated. [ 851.735646] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.736212] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.736305] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.738015] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.738015] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.744719] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e245eb8-32e9-4599-974c-039ad69ab827 in Status: IN_PROGRESS for 2s [ 852.120587] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.120759] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.120827] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.121046] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.121212] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.121282] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e0a8aca-d575-4597-b049-0d3d263dac47 is going to be created. [ 852.149180] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.149364] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.149445] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.149652] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.149813] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.158769] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e0a8aca-d575-4597-b049-0d3d263dac47 in Status: UNINITIALIZED for 2s [ 852.834149] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e245eb8-32e9-4599-974c-039ad69ab827 in Status: SUCCESS [ 852.834149] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.834149] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.834149] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.834149] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e245eb8-32e9-4599-974c-039ad69ab827',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.175779] env[70764]: INFO networking_nsxv3.common.synchronization [req-4579549b-bb34-4533-8aa7-58afc954bdce req-6e6b2bb7-4ecc-44c6-8eea-26092d16ca8b tempest-ServersTestJSON-1873194666 tempest-ServersTestJSON-1873194666-project-member] Enqueued Resource ID: 1e8d083b-4d4e-4192-8c53-ff33df47b5e7 with Priority: HIGHEST for action security_group_members [ 853.175779] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e8d083b-4d4e-4192-8c53-ff33df47b5e7 with Priority: HIGHEST for action security_group_members [ 853.176520] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e8d083b-4d4e-4192-8c53-ff33df47b5e7 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.176815] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e8d083b-4d4e-4192-8c53-ff33df47b5e7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.176984] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e8d083b-4d4e-4192-8c53-ff33df47b5e7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.177329] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e8d083b-4d4e-4192-8c53-ff33df47b5e7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.177595] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.177830] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.177995] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.178256] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.178448] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.178653] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e8d083b-4d4e-4192-8c53-ff33df47b5e7',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.212426] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46f17c96-2a3a-415a-8b88-fe6fa64e3db5 in Status: SUCCESS [ 853.214630] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.336414] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e245eb8-32e9-4599-974c-039ad69ab827 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.336554] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.653133] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-723 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.653133] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-723" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.653133] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-723" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.653133] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-723" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.653133] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.653133] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.653133] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.653133] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.653133] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.657192] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 853.657192] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 853.657192] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 853.657192] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 853.657192] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 853.657192] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 853.657192] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 853.674264] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 853.675186] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 853.675186] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 853.676970] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-723" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.676970] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-4a555a5c-0286-4e3e-aa46-121d72922c26 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.676970] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-4a555a5c-0286-4e3e-aa46-121d72922c26" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.676970] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-4a555a5c-0286-4e3e-aa46-121d72922c26" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.676970] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-4a555a5c-0286-4e3e-aa46-121d72922c26" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.676970] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a555a5c-0286-4e3e-aa46-121d72922c26',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.684031] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.684031] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.684031] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.684031] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.684031] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.684031] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.684031] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.684031] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.684031] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.684031] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.684031] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e8d083b-4d4e-4192-8c53-ff33df47b5e7 already deleted. [ 853.684031] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e8d083b-4d4e-4192-8c53-ff33df47b5e7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.757224] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e245eb8-32e9-4599-974c-039ad69ab827 in Status: SUCCESS [ 853.757303] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.757879] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.757879] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.757879] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.758295] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.758295] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.758295] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.758295] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.758613] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.758613] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9e245eb8-32e9-4599-974c-039ad69ab827',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.170040] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e0a8aca-d575-4597-b049-0d3d263dac47 in Status: SUCCESS [ 854.170040] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e0a8aca-d575-4597-b049-0d3d263dac47" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.170040] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e0a8aca-d575-4597-b049-0d3d263dac47" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.170040] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e0a8aca-d575-4597-b049-0d3d263dac47" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.170040] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.170040] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.170040] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.170040] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.170040] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.170040] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e0a8aca-d575-4597-b049-0d3d263dac47" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.170040] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0e0a8aca-d575-4597-b049-0d3d263dac47',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.184241] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.184486] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.184646] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.184944] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.185159] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.185331] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 4a555a5c-0286-4e3e-aa46-121d72922c26 not found, creating... [ 854.185604] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.185764] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.185882] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.186123] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.186265] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.186552] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.186713] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.186824] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.188158] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.188246] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.188315] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 4a555a5c-0286-4e3e-aa46-121d72922c26 is going to be created. [ 854.209694] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.209970] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.210041] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.210446] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.210623] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.210793] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-4a555a5c-0286-4e3e-aa46-121d72922c26" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.261957] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e245eb8-32e9-4599-974c-039ad69ab827 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.262127] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.262198] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.262456] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.262616] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.262721] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.262786] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.263449] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.263697] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.263843] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.264657] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e245eb8-32e9-4599-974c-039ad69ab827 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.264657] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.264657] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.264657] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.264657] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.264952] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.264952] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.264952] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.264952] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.265120] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.265239] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9e245eb8-32e9-4599-974c-039ad69ab827',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.674417] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0e0a8aca-d575-4597-b049-0d3d263dac47',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.767304] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9e245eb8-32e9-4599-974c-039ad69ab827: rpc.has_security_group_logging(os_id): False [ 854.788953] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.789350] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.789350] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.789350] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.789468] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.789656] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.789759] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.789835] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.789998] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.790133] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.794018] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.794018] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.794018] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.794018] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.794018] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.794018] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.794018] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.794018] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.794018] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.794018] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.794018] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e245eb8-32e9-4599-974c-039ad69ab827 is going to be updated. [ 854.853539] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.853732] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.853785] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.853962] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.854117] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.867093] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e245eb8-32e9-4599-974c-039ad69ab827 in Status: IN_PROGRESS for 2s [ 855.010407] env[70764]: INFO networking_nsxv3.common.synchronization [req-4579549b-bb34-4533-8aa7-58afc954bdce req-2683b460-9829-4769-9821-41b26edd3317 service nova] Enqueued Resource ID: 1e8d083b-4d4e-4192-8c53-ff33df47b5e7 with Priority: HIGHEST for action security_group_rules [ 855.010407] env[70764]: INFO networking_nsxv3.common.synchronization [req-4579549b-bb34-4533-8aa7-58afc954bdce req-2683b460-9829-4769-9821-41b26edd3317 service nova] Enqueued Resource ID: 1e8d083b-4d4e-4192-8c53-ff33df47b5e7 with Priority: HIGHEST for action security_group_members [ 855.010407] env[70764]: INFO networking_nsxv3.common.synchronization [req-4579549b-bb34-4533-8aa7-58afc954bdce req-2683b460-9829-4769-9821-41b26edd3317 service nova] Enqueued Resource ID: 4a555a5c-0286-4e3e-aa46-121d72922c26 with Priority: HIGHEST for action port [ 855.011287] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e8d083b-4d4e-4192-8c53-ff33df47b5e7 with Priority: HIGHEST for action security_group_rules [ 855.011653] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e8d083b-4d4e-4192-8c53-ff33df47b5e7 with Priority: HIGHEST for action security_group_members [ 855.012049] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a555a5c-0286-4e3e-aa46-121d72922c26 with Priority: HIGHEST for action port [ 855.012537] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e8d083b-4d4e-4192-8c53-ff33df47b5e7 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.013243] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e8d083b-4d4e-4192-8c53-ff33df47b5e7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.013500] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e8d083b-4d4e-4192-8c53-ff33df47b5e7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.014115] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e8d083b-4d4e-4192-8c53-ff33df47b5e7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.014970] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e8d083b-4d4e-4192-8c53-ff33df47b5e7',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.015320] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e8d083b-4d4e-4192-8c53-ff33df47b5e7 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.015466] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e8d083b-4d4e-4192-8c53-ff33df47b5e7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.015559] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e8d083b-4d4e-4192-8c53-ff33df47b5e7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.015781] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e8d083b-4d4e-4192-8c53-ff33df47b5e7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.015974] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.016136] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.016221] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.016406] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.016544] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.016667] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e8d083b-4d4e-4192-8c53-ff33df47b5e7',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.018312] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a555a5c-0286-4e3e-aa46-121d72922c26 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.018545] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a555a5c-0286-4e3e-aa46-121d72922c26" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.018545] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a555a5c-0286-4e3e-aa46-121d72922c26" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.018795] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a555a5c-0286-4e3e-aa46-121d72922c26" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.018869] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a555a5c-0286-4e3e-aa46-121d72922c26',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.185490] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0e0a8aca-d575-4597-b049-0d3d263dac47: rpc.has_security_group_logging(os_id): False [ 855.210454] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.211725] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.211980] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.212770] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.213375] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.217023] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.217023] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.217023] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.217023] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.217023] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.217023] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e0a8aca-d575-4597-b049-0d3d263dac47 is going to be created. [ 855.282546] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.282546] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.282546] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.282546] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.282546] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.291516] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e0a8aca-d575-4597-b049-0d3d263dac47 in Status: IN_PROGRESS for 2s [ 855.521591] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e8d083b-4d4e-4192-8c53-ff33df47b5e7',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.521591] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4a555a5c-0286-4e3e-aa46-121d72922c26 with status ACTIVE [ 855.521591] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.521591] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.521591] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.521591] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.521591] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.521591] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.521591] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.521591] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.521591] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.521591] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.523153] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.523153] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.523153] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.523153] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.523153] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.523153] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4a555a5c-0286-4e3e-aa46-121d72922c26 is going to be updated. [ 855.523771] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e8d083b-4d4e-4192-8c53-ff33df47b5e7 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.523882] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e8d083b-4d4e-4192-8c53-ff33df47b5e7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.545941] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.545941] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.545941] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.545941] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.545941] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.545941] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a555a5c-0286-4e3e-aa46-121d72922c26" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.024237] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e8d083b-4d4e-4192-8c53-ff33df47b5e7',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.526985] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.527354] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.527354] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.527501] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.527591] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.527709] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e8d083b-4d4e-4192-8c53-ff33df47b5e7 is going to be created. [ 856.583060] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.583294] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.583420] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.583877] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.583978] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.593535] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e8d083b-4d4e-4192-8c53-ff33df47b5e7 in Status: UNINITIALIZED for 2s [ 856.880764] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e245eb8-32e9-4599-974c-039ad69ab827 in Status: SUCCESS [ 856.881012] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.881218] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.881484] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.881653] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e245eb8-32e9-4599-974c-039ad69ab827',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.302731] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e0a8aca-d575-4597-b049-0d3d263dac47 in Status: SUCCESS [ 857.302933] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e0a8aca-d575-4597-b049-0d3d263dac47" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.383935] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e245eb8-32e9-4599-974c-039ad69ab827 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.384373] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.384373] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.384451] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.384561] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.384673] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.384720] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.384909] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.385050] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.385154] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.385247] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9e245eb8-32e9-4599-974c-039ad69ab827',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.888081] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e245eb8-32e9-4599-974c-039ad69ab827 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.888396] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.888396] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.888720] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.888720] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.888825] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.888861] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.889019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.889147] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.889208] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.889358] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e245eb8-32e9-4599-974c-039ad69ab827 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.889484] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.889538] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.889693] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.889833] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.889978] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.890062] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.890207] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.890281] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.890364] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.890454] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9e245eb8-32e9-4599-974c-039ad69ab827',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.393087] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9e245eb8-32e9-4599-974c-039ad69ab827: rpc.has_security_group_logging(os_id): False [ 858.417484] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.417679] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.417790] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.417921] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.418047] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.418333] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.418480] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.418665] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.418914] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.419070] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.419751] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.419910] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.419982] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.420160] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.420234] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.420455] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.420577] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.420648] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.421433] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.421563] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.421638] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e245eb8-32e9-4599-974c-039ad69ab827 is going to be updated. [ 858.505676] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.505771] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.505822] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.506039] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.506178] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.522677] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e245eb8-32e9-4599-974c-039ad69ab827 in Status: IN_PROGRESS for 2s [ 858.610377] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e8d083b-4d4e-4192-8c53-ff33df47b5e7 in Status: SUCCESS [ 858.610599] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e8d083b-4d4e-4192-8c53-ff33df47b5e7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.610765] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e8d083b-4d4e-4192-8c53-ff33df47b5e7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.610989] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e8d083b-4d4e-4192-8c53-ff33df47b5e7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.611179] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.611297] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.611360] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.611599] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.611675] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.611762] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e8d083b-4d4e-4192-8c53-ff33df47b5e7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.612055] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1e8d083b-4d4e-4192-8c53-ff33df47b5e7',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.681598] env[70764]: INFO networking_nsxv3.common.synchronization [req-f8427541-14d0-46a0-9084-9e0da82afe99 req-f8f71319-3f6a-4c17-b6a0-416f412fd12d tempest-DeleteServersTestJSON-1788501793 tempest-DeleteServersTestJSON-1788501793-project-member] Enqueued Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGHEST for action security_group_members [ 858.682142] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGHEST for action security_group_members [ 858.682551] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-3379805b-13ae-4057-9511-570e8b3c2437 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.682683] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.682750] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.682993] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.683829] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.683961] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.684021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.684180] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.684264] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.684360] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3379805b-13ae-4057-9511-570e8b3c2437',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.112524] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-974 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.112864] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-974" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.112864] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-974" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.113218] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-974" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.113501] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.113661] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.113799] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.114034] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.114177] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.114385] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 859.114517] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 859.115069] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 859.115069] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 859.115069] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 859.115069] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 859.115069] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 859.116452] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1e8d083b-4d4e-4192-8c53-ff33df47b5e7',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.135655] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 859.135655] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 859.135655] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 859.135655] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-974" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.135655] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-d4f14b86-c417-4839-9303-38694dc2c63a taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.135655] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-d4f14b86-c417-4839-9303-38694dc2c63a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.135655] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-d4f14b86-c417-4839-9303-38694dc2c63a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.135655] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-d4f14b86-c417-4839-9303-38694dc2c63a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.135655] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4f14b86-c417-4839-9303-38694dc2c63a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.188981] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.188981] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.188981] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.188981] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.188981] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.188981] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.188981] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.188981] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.188981] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.189584] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.189584] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3379805b-13ae-4057-9511-570e8b3c2437 already deleted. [ 859.189584] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.619059] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1e8d083b-4d4e-4192-8c53-ff33df47b5e7: rpc.has_security_group_logging(os_id): False [ 859.638066] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.638066] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.638235] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.640111] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.640111] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.640111] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.640111] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.640111] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.640111] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.640111] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.640111] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e8d083b-4d4e-4192-8c53-ff33df47b5e7 is going to be created. [ 859.641056] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.641251] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.641453] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.641843] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.641977] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.642137] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port d4f14b86-c417-4839-9303-38694dc2c63a not found, creating... [ 859.642398] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.642847] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.642847] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.643038] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.643120] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.643686] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.644022] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.644022] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.644365] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.644365] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.644604] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: d4f14b86-c417-4839-9303-38694dc2c63a is going to be created. [ 859.674997] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.675223] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.675350] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.675630] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.675858] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.676090] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-d4f14b86-c417-4839-9303-38694dc2c63a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.743757] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.743968] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.743968] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.744199] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.744371] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.759139] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e8d083b-4d4e-4192-8c53-ff33df47b5e7 in Status: IN_PROGRESS for 2s [ 860.507982] env[70764]: INFO networking_nsxv3.common.synchronization [req-f8427541-14d0-46a0-9084-9e0da82afe99 req-8710067e-d524-40b1-88ea-389a6d736679 service nova] Enqueued Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGHEST for action security_group_rules [ 860.508289] env[70764]: INFO networking_nsxv3.common.synchronization [req-f8427541-14d0-46a0-9084-9e0da82afe99 req-8710067e-d524-40b1-88ea-389a6d736679 service nova] Enqueued Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGHEST for action security_group_members [ 860.508367] env[70764]: INFO networking_nsxv3.common.synchronization [req-f8427541-14d0-46a0-9084-9e0da82afe99 req-8710067e-d524-40b1-88ea-389a6d736679 service nova] Enqueued Resource ID: d4f14b86-c417-4839-9303-38694dc2c63a with Priority: HIGHEST for action port [ 860.508884] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGHEST for action security_group_rules [ 860.509012] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGHEST for action security_group_members [ 860.514021] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4f14b86-c417-4839-9303-38694dc2c63a with Priority: HIGHEST for action port [ 860.514485] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3379805b-13ae-4057-9511-570e8b3c2437 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.514676] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.514784] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.515151] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.515291] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3379805b-13ae-4057-9511-570e8b3c2437',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.517398] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-3379805b-13ae-4057-9511-570e8b3c2437 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.517936] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.517936] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.517936] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.518170] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.518256] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.518317] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.518473] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.518547] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.522114] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3379805b-13ae-4057-9511-570e8b3c2437',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.523038] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-d4f14b86-c417-4839-9303-38694dc2c63a taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.523197] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d4f14b86-c417-4839-9303-38694dc2c63a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.523306] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d4f14b86-c417-4839-9303-38694dc2c63a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.523545] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d4f14b86-c417-4839-9303-38694dc2c63a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.523754] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4f14b86-c417-4839-9303-38694dc2c63a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.540786] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e245eb8-32e9-4599-974c-039ad69ab827 in Status: SUCCESS [ 860.541030] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.026133] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-3379805b-13ae-4057-9511-570e8b3c2437 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.026973] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.027281] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3379805b-13ae-4057-9511-570e8b3c2437',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.028372] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d4f14b86-c417-4839-9303-38694dc2c63a with status ACTIVE [ 861.028580] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.028724] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.028822] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.029086] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.029184] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.029374] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.029479] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.029574] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.029791] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.029875] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.030114] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.030214] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.030272] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.030447] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.030529] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.030618] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d4f14b86-c417-4839-9303-38694dc2c63a is going to be updated. [ 861.050832] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.050832] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.050832] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.050832] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.051139] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.051139] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d4f14b86-c417-4839-9303-38694dc2c63a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.534133] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3379805b-13ae-4057-9511-570e8b3c2437',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.771156] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e8d083b-4d4e-4192-8c53-ff33df47b5e7 in Status: SUCCESS [ 861.771303] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e8d083b-4d4e-4192-8c53-ff33df47b5e7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.039811] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.039811] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.039811] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.039811] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.039811] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.039811] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3379805b-13ae-4057-9511-570e8b3c2437 is going to be created. [ 862.065029] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.065029] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.065029] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.065029] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.065029] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.073735] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3379805b-13ae-4057-9511-570e8b3c2437 in Status: UNINITIALIZED for 2s [ 863.465081] env[70764]: INFO networking_nsxv3.common.synchronization [req-9f483940-d986-47a9-a19d-3bf3f692a75e req-0d3863b2-065c-4ce3-9203-28562812d743 tempest-ServersAdminTestJSON-868847224 tempest-ServersAdminTestJSON-868847224-project-member] Enqueued Resource ID: 5e9c0048-237b-4cab-86e0-e56dce546daa with Priority: HIGHEST for action security_group_members [ 863.467221] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e9c0048-237b-4cab-86e0-e56dce546daa with Priority: HIGHEST for action security_group_members [ 863.467825] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e9c0048-237b-4cab-86e0-e56dce546daa taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.467959] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.471090] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.471547] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.471655] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.471753] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.471753] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.471930] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.472106] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.472183] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e9c0048-237b-4cab-86e0-e56dce546daa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.979138] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e9c0048-237b-4cab-86e0-e56dce546daa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.085035] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3379805b-13ae-4057-9511-570e8b3c2437 in Status: SUCCESS [ 864.085200] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.085424] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.085705] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.085961] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.086177] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.086244] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.086432] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.086602] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.086721] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.086841] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3379805b-13ae-4057-9511-570e8b3c2437',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.481323] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e9c0048-237b-4cab-86e0-e56dce546daa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.589542] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-3379805b-13ae-4057-9511-570e8b3c2437 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.589705] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.589775] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.589998] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.590188] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.590290] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.590344] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.590659] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.590659] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.590659] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.590938] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-3379805b-13ae-4057-9511-570e8b3c2437 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.591126] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.591219] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.591399] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.591656] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.591788] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.591867] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.592069] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.592179] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.592292] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.592421] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3379805b-13ae-4057-9511-570e8b3c2437',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.987569] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.987748] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.987839] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.988046] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.988137] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.988244] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e9c0048-237b-4cab-86e0-e56dce546daa is going to be updated. [ 865.010717] env[70764]: INFO networking_nsxv3.common.synchronization [req-74dad422-6087-4ddc-ae65-af4fc07428df req-4944e8a5-b766-47da-825f-1593d6387177 tempest-ServerRescueTestJSON-867055778 tempest-ServerRescueTestJSON-867055778-project-member] Enqueued Resource ID: ffefe95f-97fb-4dd1-96fc-f444084d7691 with Priority: HIGHEST for action security_group_members [ 865.011348] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffefe95f-97fb-4dd1-96fc-f444084d7691 with Priority: HIGHEST for action security_group_members [ 865.011627] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffefe95f-97fb-4dd1-96fc-f444084d7691 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.011791] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.011844] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.016180] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.016463] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.016603] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.016673] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.016874] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.016960] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.017077] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ffefe95f-97fb-4dd1-96fc-f444084d7691',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.022034] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.022034] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.022034] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.022034] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.022034] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.029168] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e9c0048-237b-4cab-86e0-e56dce546daa in Status: IN_PROGRESS for 2s [ 865.100740] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3379805b-13ae-4057-9511-570e8b3c2437: rpc.has_security_group_logging(os_id): False [ 865.117778] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.117960] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.117960] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.118155] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.118239] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.118447] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.118544] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.118602] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.118741] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.118813] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.118981] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.119081] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.119140] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.119525] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.119525] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.119666] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.119737] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.119737] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.119946] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.119946] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.120875] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3379805b-13ae-4057-9511-570e8b3c2437 is going to be created. [ 865.180241] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.180393] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.180461] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.180669] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.180846] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.207460] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3379805b-13ae-4057-9511-570e8b3c2437 in Status: IN_PROGRESS for 2s [ 865.523397] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ffefe95f-97fb-4dd1-96fc-f444084d7691',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.526962] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-296 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.527958] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-296" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.527958] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-296" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.527958] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-296" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.528125] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.528390] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.530287] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.530287] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.530287] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.530287] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 865.530287] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 865.530287] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 865.530287] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 865.530287] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 865.530287] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 865.530287] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 865.549311] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 865.549615] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 865.549849] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 865.550164] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-296" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.550564] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-6b95e4e7-77fe-4b33-ab64-a69aa59dc1c9 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.550753] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-6b95e4e7-77fe-4b33-ab64-a69aa59dc1c9" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.550876] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-6b95e4e7-77fe-4b33-ab64-a69aa59dc1c9" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.551347] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-6b95e4e7-77fe-4b33-ab64-a69aa59dc1c9" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.551570] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b95e4e7-77fe-4b33-ab64-a69aa59dc1c9',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.025813] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ffefe95f-97fb-4dd1-96fc-f444084d7691',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.054377] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.054658] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.054748] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.055044] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.055203] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.055362] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 6b95e4e7-77fe-4b33-ab64-a69aa59dc1c9 not found, creating... [ 866.055630] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.055791] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.055908] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.056160] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.056276] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.056563] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.056722] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.056838] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.057052] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.057187] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.057324] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 6b95e4e7-77fe-4b33-ab64-a69aa59dc1c9 is going to be created. [ 866.074982] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.075229] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.075357] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.075633] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.075880] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.076122] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-6b95e4e7-77fe-4b33-ab64-a69aa59dc1c9" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.528715] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.529070] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.529070] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.529193] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.529995] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.529995] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffefe95f-97fb-4dd1-96fc-f444084d7691 is going to be updated. [ 866.561269] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.561421] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.561492] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.561705] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.561848] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.570044] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffefe95f-97fb-4dd1-96fc-f444084d7691 in Status: IN_PROGRESS for 2s [ 867.039022] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e9c0048-237b-4cab-86e0-e56dce546daa in Status: SUCCESS [ 867.039252] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.187703] env[70764]: INFO networking_nsxv3.common.synchronization [req-74dad422-6087-4ddc-ae65-af4fc07428df req-a061cc71-f6b1-4afd-80b9-c50d6a7d8b24 service nova] Enqueued Resource ID: ffefe95f-97fb-4dd1-96fc-f444084d7691 with Priority: HIGHEST for action security_group_rules [ 867.187703] env[70764]: INFO networking_nsxv3.common.synchronization [req-74dad422-6087-4ddc-ae65-af4fc07428df req-a061cc71-f6b1-4afd-80b9-c50d6a7d8b24 service nova] Enqueued Resource ID: ffefe95f-97fb-4dd1-96fc-f444084d7691 with Priority: HIGHEST for action security_group_members [ 867.187849] env[70764]: INFO networking_nsxv3.common.synchronization [req-74dad422-6087-4ddc-ae65-af4fc07428df req-a061cc71-f6b1-4afd-80b9-c50d6a7d8b24 service nova] Enqueued Resource ID: 6b95e4e7-77fe-4b33-ab64-a69aa59dc1c9 with Priority: HIGHEST for action port [ 867.188101] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffefe95f-97fb-4dd1-96fc-f444084d7691 with Priority: HIGHEST for action security_group_rules [ 867.188228] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffefe95f-97fb-4dd1-96fc-f444084d7691 with Priority: HIGHEST for action security_group_members [ 867.188345] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b95e4e7-77fe-4b33-ab64-a69aa59dc1c9 with Priority: HIGHEST for action port [ 867.188875] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ffefe95f-97fb-4dd1-96fc-f444084d7691 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.188995] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.189730] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.189977] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.190078] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ffefe95f-97fb-4dd1-96fc-f444084d7691',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.191410] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffefe95f-97fb-4dd1-96fc-f444084d7691 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.191555] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.191884] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b95e4e7-77fe-4b33-ab64-a69aa59dc1c9 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.192029] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b95e4e7-77fe-4b33-ab64-a69aa59dc1c9" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.192092] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b95e4e7-77fe-4b33-ab64-a69aa59dc1c9" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.192275] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b95e4e7-77fe-4b33-ab64-a69aa59dc1c9" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.192358] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b95e4e7-77fe-4b33-ab64-a69aa59dc1c9',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.222723] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3379805b-13ae-4057-9511-570e8b3c2437 in Status: SUCCESS [ 867.222723] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.418414] env[70764]: INFO networking_nsxv3.common.synchronization [req-37765e06-2ced-4bca-8306-1947f177064b req-6196beda-49f9-44c5-8fde-3060e733cafc tempest-ServerMetadataTestJSON-1768738107 tempest-ServerMetadataTestJSON-1768738107-project-member] Enqueued Resource ID: b8fbd205-3cf1-4080-a3d7-9b99aeb35f70 with Priority: HIGHEST for action security_group_members [ 867.418955] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8fbd205-3cf1-4080-a3d7-9b99aeb35f70 with Priority: HIGHEST for action security_group_members [ 867.419275] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8fbd205-3cf1-4080-a3d7-9b99aeb35f70 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.419412] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8fbd205-3cf1-4080-a3d7-9b99aeb35f70" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.419504] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8fbd205-3cf1-4080-a3d7-9b99aeb35f70" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.419760] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8fbd205-3cf1-4080-a3d7-9b99aeb35f70" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.419919] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.420194] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.420292] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.420445] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.420529] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.420621] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8fbd205-3cf1-4080-a3d7-9b99aeb35f70',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.692506] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffefe95f-97fb-4dd1-96fc-f444084d7691 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.692841] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.694073] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6b95e4e7-77fe-4b33-ab64-a69aa59dc1c9 with status ACTIVE [ 867.694287] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.694413] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.694486] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.694684] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.694761] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.694957] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.695066] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.695143] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.695271] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.695342] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.695523] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.695622] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.695687] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.695866] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.695866] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.696021] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6b95e4e7-77fe-4b33-ab64-a69aa59dc1c9 is going to be updated. [ 867.708890] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-875 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.709122] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-875" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.709573] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-875" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.709932] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-875" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.710217] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.710381] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.710738] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.710944] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.711104] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.711313] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 867.711431] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 867.711635] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 867.711823] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 867.711936] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 867.711976] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 867.712096] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 867.715887] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.716013] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.716085] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.716922] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.716922] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.716922] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b95e4e7-77fe-4b33-ab64-a69aa59dc1c9" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.729074] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 867.729307] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 867.729662] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 867.729968] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-875" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.730394] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-ead89434-bc92-4ceb-8371-a888122e07f1 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.730645] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-ead89434-bc92-4ceb-8371-a888122e07f1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.730809] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-ead89434-bc92-4ceb-8371-a888122e07f1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.731278] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-ead89434-bc92-4ceb-8371-a888122e07f1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.731432] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ead89434-bc92-4ceb-8371-a888122e07f1',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.924642] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.924642] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.924642] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.924642] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.924642] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.924878] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.924878] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.926088] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.926088] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.926088] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.926088] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8fbd205-3cf1-4080-a3d7-9b99aeb35f70 already deleted. [ 867.926088] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8fbd205-3cf1-4080-a3d7-9b99aeb35f70" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.234611] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.234857] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.234985] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.235287] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.235441] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.235594] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port ead89434-bc92-4ceb-8371-a888122e07f1 not found, creating... [ 868.235963] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.236142] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.236262] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.236480] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.236622] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.236944] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.237650] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.237970] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.238191] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.238383] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.238931] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: ead89434-bc92-4ceb-8371-a888122e07f1 is going to be created. [ 868.262457] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.262726] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.262844] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.263143] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.263440] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.263592] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-ead89434-bc92-4ceb-8371-a888122e07f1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.580904] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffefe95f-97fb-4dd1-96fc-f444084d7691 in Status: SUCCESS [ 868.581188] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.581401] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.581601] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.581938] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.581938] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.582099] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.582136] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.582235] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.582309] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ffefe95f-97fb-4dd1-96fc-f444084d7691',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.967766] env[70764]: INFO networking_nsxv3.common.synchronization [req-37765e06-2ced-4bca-8306-1947f177064b req-e824ec28-5996-4960-8b46-76d849a1fb03 service nova] Enqueued Resource ID: b8fbd205-3cf1-4080-a3d7-9b99aeb35f70 with Priority: HIGHEST for action security_group_rules [ 868.968089] env[70764]: INFO networking_nsxv3.common.synchronization [req-37765e06-2ced-4bca-8306-1947f177064b req-e824ec28-5996-4960-8b46-76d849a1fb03 service nova] Enqueued Resource ID: b8fbd205-3cf1-4080-a3d7-9b99aeb35f70 with Priority: HIGHEST for action security_group_members [ 868.969206] env[70764]: INFO networking_nsxv3.common.synchronization [req-37765e06-2ced-4bca-8306-1947f177064b req-e824ec28-5996-4960-8b46-76d849a1fb03 service nova] Enqueued Resource ID: ead89434-bc92-4ceb-8371-a888122e07f1 with Priority: HIGHEST for action port [ 868.969206] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8fbd205-3cf1-4080-a3d7-9b99aeb35f70 with Priority: HIGHEST for action security_group_rules [ 868.969206] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8fbd205-3cf1-4080-a3d7-9b99aeb35f70 with Priority: HIGHEST for action security_group_members [ 868.969206] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ead89434-bc92-4ceb-8371-a888122e07f1 with Priority: HIGHEST for action port [ 868.969664] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8fbd205-3cf1-4080-a3d7-9b99aeb35f70 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.969745] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8fbd205-3cf1-4080-a3d7-9b99aeb35f70" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.969869] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8fbd205-3cf1-4080-a3d7-9b99aeb35f70" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.970047] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8fbd205-3cf1-4080-a3d7-9b99aeb35f70" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.970177] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8fbd205-3cf1-4080-a3d7-9b99aeb35f70',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.973520] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8fbd205-3cf1-4080-a3d7-9b99aeb35f70 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.973520] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8fbd205-3cf1-4080-a3d7-9b99aeb35f70" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.973520] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8fbd205-3cf1-4080-a3d7-9b99aeb35f70" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.973520] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8fbd205-3cf1-4080-a3d7-9b99aeb35f70" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.973520] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.973520] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.973520] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.973520] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.973520] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.973520] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8fbd205-3cf1-4080-a3d7-9b99aeb35f70',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.973520] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-ead89434-bc92-4ceb-8371-a888122e07f1 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.973520] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ead89434-bc92-4ceb-8371-a888122e07f1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.973520] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ead89434-bc92-4ceb-8371-a888122e07f1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.973520] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ead89434-bc92-4ceb-8371-a888122e07f1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.973520] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ead89434-bc92-4ceb-8371-a888122e07f1',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.084514] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ffefe95f-97fb-4dd1-96fc-f444084d7691',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.475162] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8fbd205-3cf1-4080-a3d7-9b99aeb35f70',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.476294] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8fbd205-3cf1-4080-a3d7-9b99aeb35f70 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.476452] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8fbd205-3cf1-4080-a3d7-9b99aeb35f70" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.476499] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ead89434-bc92-4ceb-8371-a888122e07f1 with status ACTIVE [ 869.476656] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.476937] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.476937] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.477026] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.477104] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.477278] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.477371] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.477428] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.477577] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.477655] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.477829] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.477922] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.477988] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.478129] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.478203] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.478289] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ead89434-bc92-4ceb-8371-a888122e07f1 is going to be updated. [ 869.499594] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.499771] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.499817] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.500016] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.500161] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.500320] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ead89434-bc92-4ceb-8371-a888122e07f1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.586849] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ffefe95f-97fb-4dd1-96fc-f444084d7691',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.980839] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8fbd205-3cf1-4080-a3d7-9b99aeb35f70',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.092836] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.092836] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.092836] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.092836] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.092836] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.092836] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffefe95f-97fb-4dd1-96fc-f444084d7691 is going to be updated. [ 870.118936] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.119139] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.119209] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.119595] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.120279] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.127417] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffefe95f-97fb-4dd1-96fc-f444084d7691 in Status: IN_PROGRESS for 2s [ 870.198885] env[70764]: INFO networking_nsxv3.common.synchronization [req-e9bbb12d-eb43-42db-9df5-71d211d2a04d req-e6fe1757-23aa-4fc4-95ef-6f88e9eb4e3a tempest-ServerRescueNegativeTestJSON-1208111124 tempest-ServerRescueNegativeTestJSON-1208111124-project-member] Enqueued Resource ID: 1575c38c-2999-4e79-86e3-5e41e8eaa04a with Priority: HIGHEST for action security_group_members [ 870.199402] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1575c38c-2999-4e79-86e3-5e41e8eaa04a with Priority: HIGHEST for action security_group_members [ 870.199739] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-1575c38c-2999-4e79-86e3-5e41e8eaa04a taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.199870] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1575c38c-2999-4e79-86e3-5e41e8eaa04a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.199936] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1575c38c-2999-4e79-86e3-5e41e8eaa04a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.206297] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1575c38c-2999-4e79-86e3-5e41e8eaa04a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.206505] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.206650] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.206714] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.206864] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.206949] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.207059] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1575c38c-2999-4e79-86e3-5e41e8eaa04a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.486062] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.486062] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.486062] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.486062] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.486062] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.486062] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8fbd205-3cf1-4080-a3d7-9b99aeb35f70 is going to be created. [ 870.507483] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.507659] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.507732] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.507976] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.508158] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.518567] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8fbd205-3cf1-4080-a3d7-9b99aeb35f70 in Status: UNINITIALIZED for 2s [ 870.708831] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-904 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.709105] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-904" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.709576] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-904" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.709576] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-904" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.709799] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.709963] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.710262] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.710488] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.710641] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.711040] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 870.711040] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 870.711140] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 870.711187] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 870.711281] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 870.711389] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 870.711559] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 870.713060] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.713209] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.713312] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.713486] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.713576] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.713761] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.713855] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.713912] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.714073] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.714150] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.714237] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1575c38c-2999-4e79-86e3-5e41e8eaa04a already deleted. [ 870.714307] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1575c38c-2999-4e79-86e3-5e41e8eaa04a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.731682] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 870.731859] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 870.731988] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 870.732167] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-904" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.733637] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-23e3c821-e3a6-4ef6-aba1-ff7c8fd59afa taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.733637] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-23e3c821-e3a6-4ef6-aba1-ff7c8fd59afa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.733637] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-23e3c821-e3a6-4ef6-aba1-ff7c8fd59afa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.733637] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-23e3c821-e3a6-4ef6-aba1-ff7c8fd59afa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.733637] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23e3c821-e3a6-4ef6-aba1-ff7c8fd59afa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.235729] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.236030] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.236124] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.236408] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.236560] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.236725] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 23e3c821-e3a6-4ef6-aba1-ff7c8fd59afa not found, creating... [ 871.237041] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.237296] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.237296] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.237518] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.237732] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.237936] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.238109] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.238228] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.238438] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.238572] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.238716] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 23e3c821-e3a6-4ef6-aba1-ff7c8fd59afa is going to be created. [ 871.265307] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.265307] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.265307] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.265609] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.265609] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.265831] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-23e3c821-e3a6-4ef6-aba1-ff7c8fd59afa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.714200] env[70764]: INFO networking_nsxv3.common.synchronization [req-0af6ea24-cacc-4fe9-82bf-aebc7076650c req-fdc3b929-13d4-40f5-b575-bbc04bc7a1a9 tempest-ListServerFiltersTestJSON-1936062786 tempest-ListServerFiltersTestJSON-1936062786-project-member] Enqueued Resource ID: 9e245eb8-32e9-4599-974c-039ad69ab827 with Priority: HIGHEST for action security_group_members [ 871.714748] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e245eb8-32e9-4599-974c-039ad69ab827 with Priority: HIGHEST for action security_group_members [ 871.715946] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e245eb8-32e9-4599-974c-039ad69ab827 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.715946] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.715946] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.715946] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.715946] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.715946] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.715946] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.715946] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.715946] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.716404] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e245eb8-32e9-4599-974c-039ad69ab827',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.137174] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffefe95f-97fb-4dd1-96fc-f444084d7691 in Status: IN_PROGRESS for 4s [ 872.218414] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e245eb8-32e9-4599-974c-039ad69ab827',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.319922] env[70764]: INFO networking_nsxv3.common.synchronization [req-e9bbb12d-eb43-42db-9df5-71d211d2a04d req-53c56553-a404-466f-a106-c69b164c9128 service nova] Enqueued Resource ID: 1575c38c-2999-4e79-86e3-5e41e8eaa04a with Priority: HIGHEST for action security_group_rules [ 872.321496] env[70764]: INFO networking_nsxv3.common.synchronization [req-e9bbb12d-eb43-42db-9df5-71d211d2a04d req-53c56553-a404-466f-a106-c69b164c9128 service nova] Enqueued Resource ID: 1575c38c-2999-4e79-86e3-5e41e8eaa04a with Priority: HIGHEST for action security_group_members [ 872.321496] env[70764]: INFO networking_nsxv3.common.synchronization [req-e9bbb12d-eb43-42db-9df5-71d211d2a04d req-53c56553-a404-466f-a106-c69b164c9128 service nova] Enqueued Resource ID: 23e3c821-e3a6-4ef6-aba1-ff7c8fd59afa with Priority: HIGHEST for action port [ 872.321496] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1575c38c-2999-4e79-86e3-5e41e8eaa04a with Priority: HIGHEST for action security_group_rules [ 872.321496] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1575c38c-2999-4e79-86e3-5e41e8eaa04a with Priority: HIGHEST for action security_group_members [ 872.321496] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23e3c821-e3a6-4ef6-aba1-ff7c8fd59afa with Priority: HIGHEST for action port [ 872.321496] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1575c38c-2999-4e79-86e3-5e41e8eaa04a taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.323165] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1575c38c-2999-4e79-86e3-5e41e8eaa04a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.323165] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1575c38c-2999-4e79-86e3-5e41e8eaa04a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.323165] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1575c38c-2999-4e79-86e3-5e41e8eaa04a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.323165] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1575c38c-2999-4e79-86e3-5e41e8eaa04a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.323165] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-1575c38c-2999-4e79-86e3-5e41e8eaa04a taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.323165] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1575c38c-2999-4e79-86e3-5e41e8eaa04a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.323165] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1575c38c-2999-4e79-86e3-5e41e8eaa04a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.323527] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1575c38c-2999-4e79-86e3-5e41e8eaa04a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.323527] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.323527] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.323527] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.324123] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.324123] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.324123] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1575c38c-2999-4e79-86e3-5e41e8eaa04a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.324688] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-23e3c821-e3a6-4ef6-aba1-ff7c8fd59afa taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.324777] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23e3c821-e3a6-4ef6-aba1-ff7c8fd59afa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.327351] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23e3c821-e3a6-4ef6-aba1-ff7c8fd59afa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.327351] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23e3c821-e3a6-4ef6-aba1-ff7c8fd59afa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.327351] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23e3c821-e3a6-4ef6-aba1-ff7c8fd59afa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.533192] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8fbd205-3cf1-4080-a3d7-9b99aeb35f70 in Status: SUCCESS [ 872.533413] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8fbd205-3cf1-4080-a3d7-9b99aeb35f70" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.533657] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8fbd205-3cf1-4080-a3d7-9b99aeb35f70" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.533802] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8fbd205-3cf1-4080-a3d7-9b99aeb35f70" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.534018] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.534383] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.534383] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.534563] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.534665] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.534752] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8fbd205-3cf1-4080-a3d7-9b99aeb35f70" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.534845] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8fbd205-3cf1-4080-a3d7-9b99aeb35f70',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.721937] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e245eb8-32e9-4599-974c-039ad69ab827',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.767993] env[70764]: INFO networking_nsxv3.common.synchronization [req-0626c67c-ef11-4626-9016-e835e3874550 req-25665537-242d-42e0-8544-2f4a0c02887e tempest-DeleteServersTestJSON-1788501793 tempest-DeleteServersTestJSON-1788501793-project-member] Enqueued Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGHEST for action security_group_members [ 872.770219] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGHEST for action security_group_members [ 872.770549] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-3379805b-13ae-4057-9511-570e8b3c2437 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.770667] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.770715] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.770911] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.771082] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.771201] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.771266] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.771411] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.771519] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.771603] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3379805b-13ae-4057-9511-570e8b3c2437',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.828421] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-1575c38c-2999-4e79-86e3-5e41e8eaa04a taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.828421] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1575c38c-2999-4e79-86e3-5e41e8eaa04a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.828421] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1575c38c-2999-4e79-86e3-5e41e8eaa04a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.828711] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 23e3c821-e3a6-4ef6-aba1-ff7c8fd59afa with status ACTIVE [ 872.828893] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.829001] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.829079] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.829275] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.829367] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.829604] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.830111] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.830111] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.830111] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.830111] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.830300] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.830300] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.830300] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.830430] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.830499] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.830577] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 23e3c821-e3a6-4ef6-aba1-ff7c8fd59afa is going to be updated. [ 872.852209] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.852209] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.852209] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.852209] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.852209] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.852209] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23e3c821-e3a6-4ef6-aba1-ff7c8fd59afa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.037428] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8fbd205-3cf1-4080-a3d7-9b99aeb35f70 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.037700] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8fbd205-3cf1-4080-a3d7-9b99aeb35f70" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.037796] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8fbd205-3cf1-4080-a3d7-9b99aeb35f70" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.038051] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8fbd205-3cf1-4080-a3d7-9b99aeb35f70" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.038752] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.038881] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.038950] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.039138] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.039227] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.039343] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8fbd205-3cf1-4080-a3d7-9b99aeb35f70" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.039482] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8fbd205-3cf1-4080-a3d7-9b99aeb35f70 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.039603] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8fbd205-3cf1-4080-a3d7-9b99aeb35f70" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.039669] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8fbd205-3cf1-4080-a3d7-9b99aeb35f70" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.039820] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8fbd205-3cf1-4080-a3d7-9b99aeb35f70" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.039958] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.040064] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.040121] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.040260] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.040336] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.040417] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8fbd205-3cf1-4080-a3d7-9b99aeb35f70" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.040505] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8fbd205-3cf1-4080-a3d7-9b99aeb35f70',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.224698] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.224953] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.224953] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.225209] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.225306] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.225404] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e245eb8-32e9-4599-974c-039ad69ab827 is going to be updated. [ 873.256054] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.256054] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.256054] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.256054] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.256054] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.265319] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e245eb8-32e9-4599-974c-039ad69ab827 in Status: IN_PROGRESS for 2s [ 873.275920] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.276181] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.276181] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.276367] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.276456] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.276660] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.276760] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.276814] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.276961] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.277055] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.277129] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3379805b-13ae-4057-9511-570e8b3c2437 is going to be updated. [ 873.305672] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.305672] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.305672] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.305672] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.305672] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.312969] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3379805b-13ae-4057-9511-570e8b3c2437 in Status: IN_PROGRESS for 2s [ 873.332635] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1575c38c-2999-4e79-86e3-5e41e8eaa04a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.543377] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8fbd205-3cf1-4080-a3d7-9b99aeb35f70: rpc.has_security_group_logging(os_id): False [ 873.560800] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.560975] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.561074] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.561308] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.561400] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.561652] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.561758] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.561823] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.561980] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.562073] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.562277] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.562372] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.562433] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.562583] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.562659] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.562835] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.562928] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.562989] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.564175] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.564302] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.564406] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8fbd205-3cf1-4080-a3d7-9b99aeb35f70 is going to be created. [ 873.624961] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.624961] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.624961] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.625341] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.625341] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.634687] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8fbd205-3cf1-4080-a3d7-9b99aeb35f70 in Status: IN_PROGRESS for 2s [ 873.838196] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.838360] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.838430] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.838676] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.838758] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.838833] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1575c38c-2999-4e79-86e3-5e41e8eaa04a is going to be created. [ 873.860946] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.861121] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.861175] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.861385] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.861566] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.871830] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1575c38c-2999-4e79-86e3-5e41e8eaa04a in Status: UNINITIALIZED for 2s [ 874.146403] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffefe95f-97fb-4dd1-96fc-f444084d7691 in Status: SUCCESS [ 874.146654] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.146901] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.147176] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.147429] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.147588] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.147651] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.147876] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.148120] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.148120] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.148184] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ffefe95f-97fb-4dd1-96fc-f444084d7691',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.650254] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffefe95f-97fb-4dd1-96fc-f444084d7691 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.650671] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.650671] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.650765] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.650893] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.650987] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.651081] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.651208] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.651298] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.651383] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.651592] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffefe95f-97fb-4dd1-96fc-f444084d7691 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.651687] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.651753] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.651926] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.652085] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.652178] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.652236] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.652383] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.652458] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.652546] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.652638] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ffefe95f-97fb-4dd1-96fc-f444084d7691',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.155218] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ffefe95f-97fb-4dd1-96fc-f444084d7691: rpc.has_security_group_logging(os_id): False [ 875.171712] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.171868] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.171940] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.172188] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.172281] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.172518] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.172627] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.172672] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.172844] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.172922] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.173153] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.173253] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.173327] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.173451] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.173538] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.173724] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.173858] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.173924] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.174077] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.174166] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.174251] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ffefe95f-97fb-4dd1-96fc-f444084d7691 is going to be updated. [ 875.233061] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.233061] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.233061] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.233294] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.233421] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.249837] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ffefe95f-97fb-4dd1-96fc-f444084d7691 in Status: IN_PROGRESS for 2s [ 875.274891] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e245eb8-32e9-4599-974c-039ad69ab827 in Status: SUCCESS [ 875.274891] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.324764] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3379805b-13ae-4057-9511-570e8b3c2437 in Status: SUCCESS [ 875.324764] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3379805b-13ae-4057-9511-570e8b3c2437 deletion is rescheduled due to dependency. [ 875.324764] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.646198] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8fbd205-3cf1-4080-a3d7-9b99aeb35f70 in Status: SUCCESS [ 875.646437] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8fbd205-3cf1-4080-a3d7-9b99aeb35f70" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.883104] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1575c38c-2999-4e79-86e3-5e41e8eaa04a in Status: SUCCESS [ 875.883104] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1575c38c-2999-4e79-86e3-5e41e8eaa04a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.883104] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1575c38c-2999-4e79-86e3-5e41e8eaa04a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.883104] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1575c38c-2999-4e79-86e3-5e41e8eaa04a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.883104] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.883104] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.883104] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.883104] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.883104] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.883104] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1575c38c-2999-4e79-86e3-5e41e8eaa04a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.883104] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1575c38c-2999-4e79-86e3-5e41e8eaa04a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.386942] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1575c38c-2999-4e79-86e3-5e41e8eaa04a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.888963] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1575c38c-2999-4e79-86e3-5e41e8eaa04a: rpc.has_security_group_logging(os_id): False [ 876.906933] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.906933] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.906933] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.906933] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.907246] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.907287] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.907380] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.907430] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.907662] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.907662] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.907789] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1575c38c-2999-4e79-86e3-5e41e8eaa04a is going to be created. [ 876.965395] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.965527] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.965527] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.965692] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.965874] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.975836] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1575c38c-2999-4e79-86e3-5e41e8eaa04a in Status: IN_PROGRESS for 2s [ 877.268651] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ffefe95f-97fb-4dd1-96fc-f444084d7691 in Status: SUCCESS [ 877.268752] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.770938] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 877.771039] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 878.990148] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1575c38c-2999-4e79-86e3-5e41e8eaa04a in Status: SUCCESS [ 878.990458] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1575c38c-2999-4e79-86e3-5e41e8eaa04a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.506898] env[70764]: INFO networking_nsxv3.common.synchronization [req-2a22e206-9035-45b7-9f13-8b15b5669289 req-a1b6c329-3c48-4729-94d2-1a603b2bf8d2 tempest-ServersWithSpecificFlavorTestJSON-440557435 tempest-ServersWithSpecificFlavorTestJSON-440557435-project-member] Enqueued Resource ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 with Priority: HIGHEST for action security_group_members [ 879.507502] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 with Priority: HIGHEST for action security_group_members [ 879.507846] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-380030c5-e260-46fb-aa7e-5000c5bc9507 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.507971] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.508057] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.508254] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.508448] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.508691] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.508830] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.509162] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.509321] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.509412] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('380030c5-e260-46fb-aa7e-5000c5bc9507',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.890024] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-36 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.890282] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-36" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.890418] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-36" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.890708] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-36" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.890979] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.891420] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.891574] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.891861] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.891988] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.892229] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 879.892693] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 879.892825] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 879.893092] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 879.893092] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 879.893213] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 879.893327] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 879.914132] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 879.915494] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 879.915494] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 879.915494] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-36" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.915494] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-e83be385-6ceb-4a15-a0e8-d76f934ea521 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.915494] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-e83be385-6ceb-4a15-a0e8-d76f934ea521" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.915494] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-e83be385-6ceb-4a15-a0e8-d76f934ea521" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.915829] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-e83be385-6ceb-4a15-a0e8-d76f934ea521" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.915914] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e83be385-6ceb-4a15-a0e8-d76f934ea521',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.012339] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.012339] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.012339] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.013278] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.013278] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.013278] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.013278] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.013278] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.013598] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.013598] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.013598] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 is going to be deleted. [ 880.043778] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.044009] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.044102] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.044310] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.044413] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.044554] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.423077] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.423437] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.423548] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.423955] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.424047] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.424165] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port e83be385-6ceb-4a15-a0e8-d76f934ea521 not found, creating... [ 880.424457] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.424624] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.424772] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.424950] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.425098] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.425380] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.425535] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.425668] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.425941] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.426168] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.430056] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: e83be385-6ceb-4a15-a0e8-d76f934ea521 is going to be created. [ 880.448793] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.448990] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.449144] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.449462] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.449823] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.449940] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-e83be385-6ceb-4a15-a0e8-d76f934ea521" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.154281] env[70764]: INFO networking_nsxv3.common.synchronization [req-2a22e206-9035-45b7-9f13-8b15b5669289 req-6069c631-4364-423d-b7f1-13387c8b3c12 service nova] Enqueued Resource ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 with Priority: HIGHEST for action security_group_rules [ 881.154562] env[70764]: INFO networking_nsxv3.common.synchronization [req-2a22e206-9035-45b7-9f13-8b15b5669289 req-6069c631-4364-423d-b7f1-13387c8b3c12 service nova] Enqueued Resource ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 with Priority: HIGHEST for action security_group_members [ 881.154615] env[70764]: INFO networking_nsxv3.common.synchronization [req-2a22e206-9035-45b7-9f13-8b15b5669289 req-6069c631-4364-423d-b7f1-13387c8b3c12 service nova] Enqueued Resource ID: e83be385-6ceb-4a15-a0e8-d76f934ea521 with Priority: HIGHEST for action port [ 881.154814] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 with Priority: HIGHEST for action security_group_rules [ 881.154943] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 with Priority: HIGHEST for action security_group_members [ 881.155051] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e83be385-6ceb-4a15-a0e8-d76f934ea521 with Priority: HIGHEST for action port [ 881.155628] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-380030c5-e260-46fb-aa7e-5000c5bc9507 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.155729] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.155796] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.155987] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.158009] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('380030c5-e260-46fb-aa7e-5000c5bc9507',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.161342] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-380030c5-e260-46fb-aa7e-5000c5bc9507 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.161528] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.161573] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.161726] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.161878] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.162030] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.162125] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.162324] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.162425] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.162518] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('380030c5-e260-46fb-aa7e-5000c5bc9507',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.163368] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-e83be385-6ceb-4a15-a0e8-d76f934ea521 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.163479] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e83be385-6ceb-4a15-a0e8-d76f934ea521" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.163549] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e83be385-6ceb-4a15-a0e8-d76f934ea521" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.163700] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e83be385-6ceb-4a15-a0e8-d76f934ea521" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.163774] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e83be385-6ceb-4a15-a0e8-d76f934ea521',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.665491] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-380030c5-e260-46fb-aa7e-5000c5bc9507 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.665623] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.665819] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('380030c5-e260-46fb-aa7e-5000c5bc9507',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.666748] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e83be385-6ceb-4a15-a0e8-d76f934ea521 with status ACTIVE [ 881.666921] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.667046] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.667110] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.667542] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.667542] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.667542] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.667689] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.667689] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.668282] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.668282] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.672383] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.672383] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.672383] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.672383] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.672383] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.672383] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e83be385-6ceb-4a15-a0e8-d76f934ea521 is going to be updated. [ 881.696720] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.696856] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.696935] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.697150] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.697313] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.698084] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e83be385-6ceb-4a15-a0e8-d76f934ea521" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.172276] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('380030c5-e260-46fb-aa7e-5000c5bc9507',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.675540] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.675540] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.675540] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.675540] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.675540] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.675540] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 is going to be created. [ 882.698473] env[70764]: INFO networking_nsxv3.common.synchronization [req-983d394e-4538-42f5-b3c5-cb8141b5d86d req-5c900958-2a07-4f2e-ab9a-af60bdbec3d6 tempest-ServerMetadataTestJSON-1768738107 tempest-ServerMetadataTestJSON-1768738107-project-member] Enqueued Resource ID: b8fbd205-3cf1-4080-a3d7-9b99aeb35f70 with Priority: HIGHEST for action security_group_members [ 882.700978] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8fbd205-3cf1-4080-a3d7-9b99aeb35f70 with Priority: HIGHEST for action security_group_members [ 882.700978] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.700978] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.700978] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.700978] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.700978] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.702854] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8fbd205-3cf1-4080-a3d7-9b99aeb35f70 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.702854] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8fbd205-3cf1-4080-a3d7-9b99aeb35f70" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.703171] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8fbd205-3cf1-4080-a3d7-9b99aeb35f70" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.703171] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8fbd205-3cf1-4080-a3d7-9b99aeb35f70" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.703350] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.703432] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.703491] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.703623] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.703703] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.703793] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8fbd205-3cf1-4080-a3d7-9b99aeb35f70',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.713986] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 in Status: UNINITIALIZED for 2s [ 883.205647] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.205957] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.205957] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.206214] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.206295] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.206541] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.206652] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.206907] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.207048] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.207169] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.207271] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8fbd205-3cf1-4080-a3d7-9b99aeb35f70 is going to be updated. [ 883.246548] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.246716] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.246765] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.246968] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.247230] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.262518] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8fbd205-3cf1-4080-a3d7-9b99aeb35f70 in Status: IN_PROGRESS for 2s [ 884.117060] env[70764]: INFO networking_nsxv3.common.synchronization [req-6049a040-1391-4c44-9006-74d049f80e01 req-e752c212-64f2-4dbd-887b-4e869fdfeee8 tempest-ImagesTestJSON-1647743380 tempest-ImagesTestJSON-1647743380-project-member] Enqueued Resource ID: 4580d502-1d18-4681-96a4-28ac4e291d69 with Priority: HIGHEST for action security_group_members [ 884.117771] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4580d502-1d18-4681-96a4-28ac4e291d69 with Priority: HIGHEST for action security_group_members [ 884.118234] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4580d502-1d18-4681-96a4-28ac4e291d69 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.118494] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.118673] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.118958] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.119242] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.119462] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.119616] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.119857] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.120061] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.120245] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4580d502-1d18-4681-96a4-28ac4e291d69',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.500923] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-828 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.501291] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-828" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.501291] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-828" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.501377] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-828" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.501647] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.501811] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.501924] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.502152] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.502329] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.502507] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 884.502655] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 884.502752] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 884.502880] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 884.502946] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 884.503069] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 884.503208] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 884.521772] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 884.521958] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 884.522123] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 884.522289] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-828" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.522687] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-5e60edbf-0de2-4f7d-a6a4-d23a38508bac taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.522787] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-5e60edbf-0de2-4f7d-a6a4-d23a38508bac" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.522899] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-5e60edbf-0de2-4f7d-a6a4-d23a38508bac" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.523257] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-5e60edbf-0de2-4f7d-a6a4-d23a38508bac" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.523402] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e60edbf-0de2-4f7d-a6a4-d23a38508bac',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.622541] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.622712] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.622775] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.622979] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.654976] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.654976] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.654976] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.654976] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.654976] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.654976] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.655515] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4580d502-1d18-4681-96a4-28ac4e291d69 is going to be updated. [ 884.688996] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.689162] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.689243] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.689480] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.689636] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.698448] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4580d502-1d18-4681-96a4-28ac4e291d69 in Status: IN_PROGRESS for 2s [ 884.723961] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 in Status: SUCCESS [ 884.724198] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.762830] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.762830] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.762830] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.762830] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.762830] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.762830] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.762830] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.762830] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.762830] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('380030c5-e260-46fb-aa7e-5000c5bc9507',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.025702] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.026117] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.026117] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.026430] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.027907] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.027907] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 5e60edbf-0de2-4f7d-a6a4-d23a38508bac not found, creating... [ 885.027907] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.027907] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.027907] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.031155] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.031155] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.031155] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.031155] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.031155] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.031155] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.031155] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.031155] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 5e60edbf-0de2-4f7d-a6a4-d23a38508bac is going to be created. [ 885.048625] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.048836] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.048976] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.053774] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.053774] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.054361] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-5e60edbf-0de2-4f7d-a6a4-d23a38508bac" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.229121] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('380030c5-e260-46fb-aa7e-5000c5bc9507',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.272909] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8fbd205-3cf1-4080-a3d7-9b99aeb35f70 in Status: SUCCESS [ 885.273104] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8fbd205-3cf1-4080-a3d7-9b99aeb35f70 deletion is rescheduled due to dependency. [ 885.273213] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8fbd205-3cf1-4080-a3d7-9b99aeb35f70" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.734542] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 380030c5-e260-46fb-aa7e-5000c5bc9507: rpc.has_security_group_logging(os_id): False [ 885.752792] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.752968] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.753062] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.753286] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.753370] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.753685] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.753805] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.753873] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.754055] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.754122] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.754240] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 is going to be created. [ 885.810384] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.810384] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.810477] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.810643] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.810804] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.828703] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 in Status: IN_PROGRESS for 2s [ 885.904340] env[70764]: INFO networking_nsxv3.common.synchronization [req-6049a040-1391-4c44-9006-74d049f80e01 req-643162ce-a073-444e-bd98-5e0782d385e5 service nova] Enqueued Resource ID: 4580d502-1d18-4681-96a4-28ac4e291d69 with Priority: HIGHEST for action security_group_rules [ 885.904503] env[70764]: INFO networking_nsxv3.common.synchronization [req-6049a040-1391-4c44-9006-74d049f80e01 req-643162ce-a073-444e-bd98-5e0782d385e5 service nova] Enqueued Resource ID: 4580d502-1d18-4681-96a4-28ac4e291d69 with Priority: HIGHEST for action security_group_members [ 885.905286] env[70764]: INFO networking_nsxv3.common.synchronization [req-6049a040-1391-4c44-9006-74d049f80e01 req-643162ce-a073-444e-bd98-5e0782d385e5 service nova] Enqueued Resource ID: 5e60edbf-0de2-4f7d-a6a4-d23a38508bac with Priority: HIGHEST for action port [ 885.905674] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4580d502-1d18-4681-96a4-28ac4e291d69 with Priority: HIGHEST for action security_group_rules [ 885.905818] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4580d502-1d18-4681-96a4-28ac4e291d69 with Priority: HIGHEST for action security_group_members [ 885.906152] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e60edbf-0de2-4f7d-a6a4-d23a38508bac with Priority: HIGHEST for action port [ 885.906507] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4580d502-1d18-4681-96a4-28ac4e291d69 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.906625] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.906766] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.907102] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.907196] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4580d502-1d18-4681-96a4-28ac4e291d69',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.908984] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4580d502-1d18-4681-96a4-28ac4e291d69 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.908984] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.908984] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e60edbf-0de2-4f7d-a6a4-d23a38508bac taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.908984] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e60edbf-0de2-4f7d-a6a4-d23a38508bac" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.908984] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e60edbf-0de2-4f7d-a6a4-d23a38508bac" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.908984] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e60edbf-0de2-4f7d-a6a4-d23a38508bac" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.908984] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e60edbf-0de2-4f7d-a6a4-d23a38508bac',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.410708] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4580d502-1d18-4681-96a4-28ac4e291d69 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.411742] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.412089] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5e60edbf-0de2-4f7d-a6a4-d23a38508bac with status ACTIVE [ 886.412288] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.412420] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.412491] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.412726] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.412819] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.413054] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.413173] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.413173] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.413306] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.413408] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.413575] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.413666] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.413738] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.413884] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.413954] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.414066] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5e60edbf-0de2-4f7d-a6a4-d23a38508bac is going to be updated. [ 886.436269] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.436370] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.437941] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.437941] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.437941] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.437941] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e60edbf-0de2-4f7d-a6a4-d23a38508bac" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.709796] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4580d502-1d18-4681-96a4-28ac4e291d69 in Status: SUCCESS [ 886.711395] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4580d502-1d18-4681-96a4-28ac4e291d69 deletion is rescheduled due to dependency. [ 886.711724] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.712107] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.712518] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.712907] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.713298] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.713521] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.713876] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.714140] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.714403] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4580d502-1d18-4681-96a4-28ac4e291d69',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.917652] env[70764]: INFO networking_nsxv3.common.synchronization [req-a9789802-caac-4441-8e3c-e196d2b8fa21 req-eb137cc0-e29d-466f-93ad-43b5c9c5d77b tempest-ServerDiskConfigTestJSON-1914051978 tempest-ServerDiskConfigTestJSON-1914051978-project-member] Enqueued Resource ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 with Priority: HIGHEST for action security_group_members [ 886.918081] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 with Priority: HIGHEST for action security_group_members [ 886.918371] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-56646d46-eb79-4ebc-a596-a5a17716f8e4 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.918489] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.918564] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.918826] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.918975] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.919085] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.919144] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.919451] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.919451] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.919671] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56646d46-eb79-4ebc-a596-a5a17716f8e4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.221347] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4580d502-1d18-4681-96a4-28ac4e291d69',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.425279] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-829 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.425279] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-829" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.425279] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-829" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.425279] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-829" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.425279] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.425279] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.425279] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.425279] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.425718] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.427320] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 887.427503] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 887.427651] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 887.427917] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 887.428192] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 887.428353] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 887.428602] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 887.430977] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.430977] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.430977] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.431288] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.431288] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.433587] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.433587] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.433587] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.433587] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.433587] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.433587] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 already deleted. [ 887.433587] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.459135] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 887.459135] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 887.459135] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 887.459322] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-829" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.459726] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-52cb1f97-227e-411a-b9fe-56642dbe7294 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.459992] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-52cb1f97-227e-411a-b9fe-56642dbe7294" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.460204] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-52cb1f97-227e-411a-b9fe-56642dbe7294" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.460571] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-52cb1f97-227e-411a-b9fe-56642dbe7294" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.460733] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52cb1f97-227e-411a-b9fe-56642dbe7294',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.724838] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4580d502-1d18-4681-96a4-28ac4e291d69',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.842217] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 in Status: SUCCESS [ 887.842455] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.963718] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.964317] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.964317] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.964382] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.964538] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.964731] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 52cb1f97-227e-411a-b9fe-56642dbe7294 not found, creating... [ 887.965011] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.965192] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.965312] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.965538] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.965681] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.965966] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.966187] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.966245] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.966448] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.966617] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.966767] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 52cb1f97-227e-411a-b9fe-56642dbe7294 is going to be created. [ 887.986049] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.986049] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.986049] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.986049] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.986049] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.986360] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-52cb1f97-227e-411a-b9fe-56642dbe7294" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.230740] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.230936] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.230999] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.231440] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.232045] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.232045] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4580d502-1d18-4681-96a4-28ac4e291d69 is going to be updated. [ 888.260304] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.260304] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.260304] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.260304] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.260304] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.268043] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4580d502-1d18-4681-96a4-28ac4e291d69 in Status: IN_PROGRESS for 2s [ 888.984237] env[70764]: INFO networking_nsxv3.common.synchronization [req-a9789802-caac-4441-8e3c-e196d2b8fa21 req-bee02b23-2912-4c3f-bec7-735db42505cb service nova] Enqueued Resource ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 with Priority: HIGHEST for action security_group_rules [ 888.984237] env[70764]: INFO networking_nsxv3.common.synchronization [req-a9789802-caac-4441-8e3c-e196d2b8fa21 req-bee02b23-2912-4c3f-bec7-735db42505cb service nova] Enqueued Resource ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 with Priority: HIGHEST for action security_group_members [ 888.984237] env[70764]: INFO networking_nsxv3.common.synchronization [req-a9789802-caac-4441-8e3c-e196d2b8fa21 req-bee02b23-2912-4c3f-bec7-735db42505cb service nova] Enqueued Resource ID: 52cb1f97-227e-411a-b9fe-56642dbe7294 with Priority: HIGHEST for action port [ 888.984237] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 with Priority: HIGHEST for action security_group_rules [ 888.984237] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 with Priority: HIGHEST for action security_group_members [ 888.984642] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52cb1f97-227e-411a-b9fe-56642dbe7294 with Priority: HIGHEST for action port [ 888.984826] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-56646d46-eb79-4ebc-a596-a5a17716f8e4 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.985475] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.985624] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.985966] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.986203] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('56646d46-eb79-4ebc-a596-a5a17716f8e4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.987125] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-56646d46-eb79-4ebc-a596-a5a17716f8e4 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.987298] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.987912] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.987977] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.988157] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.988417] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.991013] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.991013] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.991013] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.991013] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56646d46-eb79-4ebc-a596-a5a17716f8e4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.991013] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-52cb1f97-227e-411a-b9fe-56642dbe7294 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.991013] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52cb1f97-227e-411a-b9fe-56642dbe7294" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.991013] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52cb1f97-227e-411a-b9fe-56642dbe7294" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.991013] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52cb1f97-227e-411a-b9fe-56642dbe7294" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.991013] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52cb1f97-227e-411a-b9fe-56642dbe7294',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.492685] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 52cb1f97-227e-411a-b9fe-56642dbe7294 with status ACTIVE [ 889.492946] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.493101] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.493167] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.493377] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.493464] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.493648] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.493746] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.493807] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.493977] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.494070] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.494245] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.494337] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.494396] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.494532] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.494618] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.494690] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 52cb1f97-227e-411a-b9fe-56642dbe7294 is going to be updated. [ 889.495882] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-56646d46-eb79-4ebc-a596-a5a17716f8e4 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.495984] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.496157] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('56646d46-eb79-4ebc-a596-a5a17716f8e4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.522472] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.522657] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.522747] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.522994] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.523204] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.523390] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52cb1f97-227e-411a-b9fe-56642dbe7294" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.998259] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('56646d46-eb79-4ebc-a596-a5a17716f8e4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.277634] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4580d502-1d18-4681-96a4-28ac4e291d69 in Status: SUCCESS [ 890.277865] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.278047] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.278453] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.278510] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.278577] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.278659] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.278838] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.278922] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.279042] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.279177] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4580d502-1d18-4681-96a4-28ac4e291d69',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.500309] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.500486] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.500571] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.500836] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.500941] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.501063] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 is going to be created. [ 890.533172] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.533423] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.533423] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.533645] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.533809] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.542815] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 in Status: UNINITIALIZED for 2s [ 890.784218] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4580d502-1d18-4681-96a4-28ac4e291d69 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.784218] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.784218] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.784218] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.784218] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.784218] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.784218] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.784218] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.784218] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.784218] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.784218] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4580d502-1d18-4681-96a4-28ac4e291d69 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.784218] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.784218] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.784218] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.784218] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.784218] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.784731] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.784731] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.784731] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.784731] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.784731] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4580d502-1d18-4681-96a4-28ac4e291d69',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.287403] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4580d502-1d18-4681-96a4-28ac4e291d69: rpc.has_security_group_logging(os_id): False [ 891.306564] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.306564] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.306564] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.306564] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.306753] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.306869] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.306958] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.307024] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.307176] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.307252] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.307428] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.307544] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.307596] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.307756] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.307856] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.308042] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.308151] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.308230] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.308295] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.308362] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.308448] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4580d502-1d18-4681-96a4-28ac4e291d69 is going to be updated. [ 891.364222] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.364376] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.364493] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.364644] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.364785] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.380696] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4580d502-1d18-4681-96a4-28ac4e291d69 in Status: IN_PROGRESS for 2s [ 891.930031] env[70764]: INFO networking_nsxv3.common.synchronization [req-91671ea2-cdc1-4782-9d52-897ac21eedaa req-ecf4c8f3-4e2d-48b2-aa8a-a6ae41265b20 tempest-ImagesOneServerNegativeTestJSON-1318507346 tempest-ImagesOneServerNegativeTestJSON-1318507346-project-member] Enqueued Resource ID: 2a93825c-656b-4f3f-b946-3346edd746bf with Priority: HIGHEST for action security_group_members [ 891.930635] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a93825c-656b-4f3f-b946-3346edd746bf with Priority: HIGHEST for action security_group_members [ 891.931190] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a93825c-656b-4f3f-b946-3346edd746bf taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.931489] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.931661] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.931947] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.932191] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.932393] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.932522] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.932747] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.932926] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.933102] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a93825c-656b-4f3f-b946-3346edd746bf',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.331240] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-340 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.331576] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-340" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.331576] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-340" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.331870] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-340" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.332257] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.332539] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.332731] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.333056] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.333458] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.334207] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 892.334207] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 892.334207] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 892.334207] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 892.334741] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 892.334955] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 892.335173] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 892.364319] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 892.365117] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 892.365117] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 892.365117] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-340" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.365296] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-6d71d2e9-1fc9-41bc-b697-19c5ffbe31de taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.365484] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-6d71d2e9-1fc9-41bc-b697-19c5ffbe31de" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.365627] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-6d71d2e9-1fc9-41bc-b697-19c5ffbe31de" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.369020] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-6d71d2e9-1fc9-41bc-b697-19c5ffbe31de" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.369020] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d71d2e9-1fc9-41bc-b697-19c5ffbe31de',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.435925] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.436136] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.436215] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.436469] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.436572] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.436942] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.437259] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.437341] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.437514] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.437595] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.437689] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a93825c-656b-4f3f-b946-3346edd746bf is going to be deleted. [ 892.469349] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.469529] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.469619] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.469850] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.469936] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.470045] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.562401] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 in Status: SUCCESS [ 892.562401] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.562401] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.562401] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.562401] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.562401] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.562401] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.562401] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.562401] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.562401] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.562401] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('56646d46-eb79-4ebc-a596-a5a17716f8e4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.870225] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.870445] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.870576] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.870897] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.871069] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.871240] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 6d71d2e9-1fc9-41bc-b697-19c5ffbe31de not found, creating... [ 892.871672] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.871830] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.871970] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.872214] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.872355] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.873350] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.874539] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.874539] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.874539] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.874539] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.874539] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 6d71d2e9-1fc9-41bc-b697-19c5ffbe31de is going to be created. [ 892.895302] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.895548] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.895675] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.895974] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.896236] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.896501] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-6d71d2e9-1fc9-41bc-b697-19c5ffbe31de" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.062433] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-56646d46-eb79-4ebc-a596-a5a17716f8e4 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.062598] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.062672] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.062896] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.063079] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.063204] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.063235] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.063379] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.063465] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.063553] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.063701] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-56646d46-eb79-4ebc-a596-a5a17716f8e4 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.063793] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.063851] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.064113] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.064263] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.064358] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.064419] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.064555] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.064634] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.064717] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.064807] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('56646d46-eb79-4ebc-a596-a5a17716f8e4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.397249] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4580d502-1d18-4681-96a4-28ac4e291d69 in Status: SUCCESS [ 893.397560] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.567421] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 56646d46-eb79-4ebc-a596-a5a17716f8e4: rpc.has_security_group_logging(os_id): False [ 893.588362] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.588509] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.588583] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.588834] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.588884] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.589102] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.589242] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.589282] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.589440] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.589599] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.589749] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.589855] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.590128] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.590282] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.590325] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.590514] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.590607] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.590732] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.590800] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.590873] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.590957] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 is going to be created. [ 893.651237] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.651357] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.651410] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.651850] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.652212] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.661640] env[70764]: INFO networking_nsxv3.common.synchronization [req-91671ea2-cdc1-4782-9d52-897ac21eedaa req-9c793005-8281-4806-87cc-17793c49e0dd service nova] Enqueued Resource ID: 2a93825c-656b-4f3f-b946-3346edd746bf with Priority: HIGHEST for action security_group_rules [ 893.661955] env[70764]: INFO networking_nsxv3.common.synchronization [req-91671ea2-cdc1-4782-9d52-897ac21eedaa req-9c793005-8281-4806-87cc-17793c49e0dd service nova] Enqueued Resource ID: 2a93825c-656b-4f3f-b946-3346edd746bf with Priority: HIGHEST for action security_group_members [ 893.662247] env[70764]: INFO networking_nsxv3.common.synchronization [req-91671ea2-cdc1-4782-9d52-897ac21eedaa req-9c793005-8281-4806-87cc-17793c49e0dd service nova] Enqueued Resource ID: 6d71d2e9-1fc9-41bc-b697-19c5ffbe31de with Priority: HIGHEST for action port [ 893.664665] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a93825c-656b-4f3f-b946-3346edd746bf with Priority: HIGHEST for action security_group_rules [ 893.664665] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a93825c-656b-4f3f-b946-3346edd746bf with Priority: HIGHEST for action security_group_members [ 893.664665] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d71d2e9-1fc9-41bc-b697-19c5ffbe31de with Priority: HIGHEST for action port [ 893.664879] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 in Status: IN_PROGRESS for 2s [ 893.665264] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a93825c-656b-4f3f-b946-3346edd746bf taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.665506] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.665557] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.665838] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.665973] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a93825c-656b-4f3f-b946-3346edd746bf',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.667275] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a93825c-656b-4f3f-b946-3346edd746bf taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.667457] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.667567] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.667893] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.668123] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.668283] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.668388] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.668631] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.668771] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.668919] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a93825c-656b-4f3f-b946-3346edd746bf',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.670279] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d71d2e9-1fc9-41bc-b697-19c5ffbe31de taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.671030] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d71d2e9-1fc9-41bc-b697-19c5ffbe31de" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.671030] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d71d2e9-1fc9-41bc-b697-19c5ffbe31de" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.671301] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d71d2e9-1fc9-41bc-b697-19c5ffbe31de" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.671350] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d71d2e9-1fc9-41bc-b697-19c5ffbe31de',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.175385] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a93825c-656b-4f3f-b946-3346edd746bf',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.176328] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6d71d2e9-1fc9-41bc-b697-19c5ffbe31de with status ACTIVE [ 894.176538] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.176666] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.176734] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.176930] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.177032] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.177214] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.177314] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.177375] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.177511] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.177591] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.177790] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.177893] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.177958] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.178111] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.178200] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.178266] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6d71d2e9-1fc9-41bc-b697-19c5ffbe31de is going to be updated. [ 894.180489] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a93825c-656b-4f3f-b946-3346edd746bf taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.180609] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.206320] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.206460] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.206529] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.206736] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.206868] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.207033] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d71d2e9-1fc9-41bc-b697-19c5ffbe31de" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.522442] env[70764]: INFO networking_nsxv3.common.synchronization [req-e0f6c9f7-ec21-4955-882b-90978e1f6878 req-8f800583-89ff-44f0-b56d-94ec85e154fa tempest-ServersTestManualDisk-1468672688 tempest-ServersTestManualDisk-1468672688-project-member] Enqueued Resource ID: 4402a532-4a5c-4a18-993a-a6249c552031 with Priority: HIGHEST for action security_group_members [ 894.523298] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4402a532-4a5c-4a18-993a-a6249c552031 with Priority: HIGHEST for action security_group_members [ 894.523447] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4402a532-4a5c-4a18-993a-a6249c552031 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.523572] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4402a532-4a5c-4a18-993a-a6249c552031" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.523646] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4402a532-4a5c-4a18-993a-a6249c552031" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.523888] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4402a532-4a5c-4a18-993a-a6249c552031" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.524104] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.524228] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.524294] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.524461] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.524552] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.524660] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4402a532-4a5c-4a18-993a-a6249c552031',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.684354] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a93825c-656b-4f3f-b946-3346edd746bf',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.033388] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.033388] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.033388] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.033388] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.033388] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.033388] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.033388] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.033388] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.033388] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.033388] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.033388] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4402a532-4a5c-4a18-993a-a6249c552031 is going to be updated. [ 895.059904] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.059904] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.059904] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.059904] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.059904] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.066656] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4402a532-4a5c-4a18-993a-a6249c552031 in Status: IN_PROGRESS for 2s [ 895.189562] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.189731] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.189804] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.190078] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.190182] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.190290] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a93825c-656b-4f3f-b946-3346edd746bf is going to be created. [ 895.229181] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.229181] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.229331] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.229569] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.229760] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.240662] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a93825c-656b-4f3f-b946-3346edd746bf in Status: UNINITIALIZED for 2s [ 895.677661] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 in Status: SUCCESS [ 895.677661] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.005239] env[70764]: INFO networking_nsxv3.common.synchronization [req-59da69cb-4c1d-4ca0-8f6a-64a43f18a99d req-c05d89a3-615e-4621-a049-36f73ff6301c tempest-ServersAdminTestJSON-868847224 tempest-ServersAdminTestJSON-868847224-project-member] Enqueued Resource ID: 5e9c0048-237b-4cab-86e0-e56dce546daa with Priority: HIGHEST for action security_group_members [ 896.006272] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e9c0048-237b-4cab-86e0-e56dce546daa with Priority: HIGHEST for action security_group_members [ 896.006640] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e9c0048-237b-4cab-86e0-e56dce546daa taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.006798] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.006882] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.007146] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.007345] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.007478] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.007563] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.007751] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.007859] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.007981] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e9c0048-237b-4cab-86e0-e56dce546daa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.106040] env[70764]: INFO networking_nsxv3.common.synchronization [None req-9f05a617-e84e-46f2-9024-57ea5ae46480 None None] Enqueued Resource ID: ff9b04e8-26e8-4402-b352-dfec46d4921d with Priority: HIGHEST for action port [ 896.106624] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff9b04e8-26e8-4402-b352-dfec46d4921d with Priority: HIGHEST for action port [ 896.106980] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff9b04e8-26e8-4402-b352-dfec46d4921d taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.107341] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff9b04e8-26e8-4402-b352-dfec46d4921d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.107431] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff9b04e8-26e8-4402-b352-dfec46d4921d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.107970] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff9b04e8-26e8-4402-b352-dfec46d4921d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.108073] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff9b04e8-26e8-4402-b352-dfec46d4921d',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.517638] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e9c0048-237b-4cab-86e0-e56dce546daa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.612403] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ff9b04e8-26e8-4402-b352-dfec46d4921d [ 896.612658] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.612788] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.612856] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.613131] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.613289] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.613447] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ff9b04e8-26e8-4402-b352-dfec46d4921d already deleted. [ 896.613581] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff9b04e8-26e8-4402-b352-dfec46d4921d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.762615] env[70764]: INFO networking_nsxv3.common.synchronization [req-d6ddf62f-8048-48e2-9edd-be27d646a4c9 req-ce8fb839-cc16-490f-be46-254027087020 tempest-ServerRescueTestJSON-867055778 tempest-ServerRescueTestJSON-867055778-project-member] Enqueued Resource ID: ffefe95f-97fb-4dd1-96fc-f444084d7691 with Priority: HIGHEST for action security_group_members [ 896.763817] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffefe95f-97fb-4dd1-96fc-f444084d7691 with Priority: HIGHEST for action security_group_members [ 896.763817] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffefe95f-97fb-4dd1-96fc-f444084d7691 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.763817] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.763817] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.765392] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.765392] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.765392] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.765392] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.765392] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.765392] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.765392] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ffefe95f-97fb-4dd1-96fc-f444084d7691',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.020165] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e9c0048-237b-4cab-86e0-e56dce546daa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.078741] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4402a532-4a5c-4a18-993a-a6249c552031 in Status: SUCCESS [ 897.078963] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4402a532-4a5c-4a18-993a-a6249c552031 deletion is rescheduled due to dependency. [ 897.079179] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4402a532-4a5c-4a18-993a-a6249c552031" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.252799] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a93825c-656b-4f3f-b946-3346edd746bf in Status: SUCCESS [ 897.252799] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.252891] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.253138] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.253373] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.253476] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.253547] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.253706] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.253809] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.253884] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.253975] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2a93825c-656b-4f3f-b946-3346edd746bf',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.272066] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ffefe95f-97fb-4dd1-96fc-f444084d7691',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.523293] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.523877] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.523877] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.523877] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.523877] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.524084] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e9c0048-237b-4cab-86e0-e56dce546daa is going to be updated. [ 897.556949] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.557129] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.557129] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.557298] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.557527] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.574198] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e9c0048-237b-4cab-86e0-e56dce546daa in Status: IN_PROGRESS for 2s [ 897.756529] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a93825c-656b-4f3f-b946-3346edd746bf taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.756893] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.756893] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.757068] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.757174] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.757280] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.757338] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.757499] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.757581] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.757674] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.757921] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a93825c-656b-4f3f-b946-3346edd746bf taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.757921] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.758030] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.758115] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.758250] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.758341] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.758397] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.758684] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.758903] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.758903] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.759022] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2a93825c-656b-4f3f-b946-3346edd746bf',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.773791] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ffefe95f-97fb-4dd1-96fc-f444084d7691',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.261766] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2a93825c-656b-4f3f-b946-3346edd746bf: rpc.has_security_group_logging(os_id): False [ 898.278084] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.278084] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.278084] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.278084] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.278084] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.278084] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffefe95f-97fb-4dd1-96fc-f444084d7691 is going to be updated. [ 898.280538] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.280687] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.280756] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.280960] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.281067] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.281233] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.281342] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.281403] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.281539] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.281656] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.281873] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.281968] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.282039] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.282202] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.283980] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.283980] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.283980] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.283980] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.283980] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.283980] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.283980] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a93825c-656b-4f3f-b946-3346edd746bf is going to be created. [ 898.309652] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.309811] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.309897] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.310128] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.310265] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.326170] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffefe95f-97fb-4dd1-96fc-f444084d7691 in Status: IN_PROGRESS for 2s [ 898.373384] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.373540] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.373611] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.373867] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.374292] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.388831] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a93825c-656b-4f3f-b946-3346edd746bf in Status: IN_PROGRESS for 2s [ 898.577114] env[70764]: INFO networking_nsxv3.common.synchronization [None req-f57c35ee-d44e-43b5-bf9f-a6f4e42c5c2a None None] Enqueued Resource ID: e5e1737f-ffc5-4faf-a764-4eed73dc005d with Priority: HIGHEST for action port [ 898.577875] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5e1737f-ffc5-4faf-a764-4eed73dc005d with Priority: HIGHEST for action port [ 898.577942] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5e1737f-ffc5-4faf-a764-4eed73dc005d taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.578082] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5e1737f-ffc5-4faf-a764-4eed73dc005d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.578152] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5e1737f-ffc5-4faf-a764-4eed73dc005d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.578399] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5e1737f-ffc5-4faf-a764-4eed73dc005d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.578482] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5e1737f-ffc5-4faf-a764-4eed73dc005d',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.083211] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e5e1737f-ffc5-4faf-a764-4eed73dc005d [ 899.084130] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.084130] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.084130] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.084130] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.084130] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.084360] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e5e1737f-ffc5-4faf-a764-4eed73dc005d already deleted. [ 899.084360] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5e1737f-ffc5-4faf-a764-4eed73dc005d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.333554] env[70764]: INFO networking_nsxv3.common.synchronization [req-b8f60536-820b-4cd5-bfa3-2b8c8adaba48 req-81457b79-aba5-4639-a1e3-b130dace429f tempest-ServersTestJSON-88830314 tempest-ServersTestJSON-88830314-project-member] Enqueued Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_members [ 899.333980] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_members [ 899.334831] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.334831] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.334831] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.335042] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.335042] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.335119] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.335185] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.335329] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.335409] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.335509] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.582792] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e9c0048-237b-4cab-86e0-e56dce546daa in Status: SUCCESS [ 899.583189] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.839508] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.948757] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-603 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.948872] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-603" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.948911] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-603" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.949253] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-603" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.950012] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.950115] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.950260] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.950544] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.950601] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.950807] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 899.950992] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 899.951067] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 899.951153] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 899.951265] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 899.951405] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 899.951543] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 899.971498] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 899.971740] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 899.971898] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 899.972123] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-603" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.975093] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-7da37ce8-9285-497e-b115-147a6ebce819 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.975093] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-7da37ce8-9285-497e-b115-147a6ebce819" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.975093] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-7da37ce8-9285-497e-b115-147a6ebce819" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.975093] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-7da37ce8-9285-497e-b115-147a6ebce819" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.975093] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7da37ce8-9285-497e-b115-147a6ebce819',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.336979] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffefe95f-97fb-4dd1-96fc-f444084d7691 in Status: SUCCESS [ 900.337437] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.340664] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.402724] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a93825c-656b-4f3f-b946-3346edd746bf in Status: SUCCESS [ 900.403169] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.422810] env[70764]: INFO networking_nsxv3.common.synchronization [req-49ed19a7-e007-4597-a2c0-1dd3e9d04c4c req-81680e31-903a-4351-89c5-b51544b75c9f tempest-AttachVolumeNegativeTest-232785497 tempest-AttachVolumeNegativeTest-232785497-project-member] Enqueued Resource ID: 0e0a8aca-d575-4597-b049-0d3d263dac47 with Priority: HIGHEST for action security_group_members [ 900.423399] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e0a8aca-d575-4597-b049-0d3d263dac47 with Priority: HIGHEST for action security_group_members [ 900.423724] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e0a8aca-d575-4597-b049-0d3d263dac47 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.423839] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e0a8aca-d575-4597-b049-0d3d263dac47" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.424034] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e0a8aca-d575-4597-b049-0d3d263dac47" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.425162] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e0a8aca-d575-4597-b049-0d3d263dac47" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.425162] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.425162] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.425162] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.425162] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.425432] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.425432] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e0a8aca-d575-4597-b049-0d3d263dac47',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.475417] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.475665] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.475853] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.476061] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.476212] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.476368] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 7da37ce8-9285-497e-b115-147a6ebce819 not found, creating... [ 900.476636] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.477031] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.477183] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.477408] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.477552] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.477868] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.478142] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.478142] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.478596] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.478669] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.478812] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 7da37ce8-9285-497e-b115-147a6ebce819 is going to be created. [ 900.497273] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.500577] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.500802] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.501080] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.501262] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.501660] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-7da37ce8-9285-497e-b115-147a6ebce819" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.530069] env[70764]: INFO networking_nsxv3.common.synchronization [req-0808c81d-5821-4082-9fc2-09259a0bf69b req-1463e2ab-e756-419e-af0d-8eef32f1e597 tempest-ListServerFiltersTestJSON-1936062786 tempest-ListServerFiltersTestJSON-1936062786-project-member] Enqueued Resource ID: 9e245eb8-32e9-4599-974c-039ad69ab827 with Priority: HIGHEST for action security_group_members [ 900.530393] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e245eb8-32e9-4599-974c-039ad69ab827 with Priority: HIGHEST for action security_group_members [ 900.530711] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e245eb8-32e9-4599-974c-039ad69ab827 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.530836] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.531807] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.532050] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.532215] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.532321] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.532384] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.532599] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.532635] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.532702] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e245eb8-32e9-4599-974c-039ad69ab827',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.845579] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.845734] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.845798] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.846030] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.846127] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.846225] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8f5efec-a14e-4be6-8add-7b35a995c982 is going to be updated. [ 900.874605] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.874605] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.874605] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.874605] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.874605] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.885398] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: IN_PROGRESS for 2s [ 900.927637] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.927952] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.928695] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.928695] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.928695] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.928863] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.929039] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.929159] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.929402] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.929541] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.929677] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e0a8aca-d575-4597-b049-0d3d263dac47 is going to be updated. [ 900.961629] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.961629] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.961629] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.961629] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.961629] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.974184] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e0a8aca-d575-4597-b049-0d3d263dac47 in Status: IN_PROGRESS for 2s [ 901.037657] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e245eb8-32e9-4599-974c-039ad69ab827',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.537644] env[70764]: INFO networking_nsxv3.common.synchronization [req-b8f60536-820b-4cd5-bfa3-2b8c8adaba48 req-02215776-ce40-45d1-af77-9fe8775297f1 service nova] Enqueued Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_rules [ 901.537919] env[70764]: INFO networking_nsxv3.common.synchronization [req-b8f60536-820b-4cd5-bfa3-2b8c8adaba48 req-02215776-ce40-45d1-af77-9fe8775297f1 service nova] Enqueued Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_members [ 901.537962] env[70764]: INFO networking_nsxv3.common.synchronization [req-b8f60536-820b-4cd5-bfa3-2b8c8adaba48 req-02215776-ce40-45d1-af77-9fe8775297f1 service nova] Enqueued Resource ID: 7da37ce8-9285-497e-b115-147a6ebce819 with Priority: HIGHEST for action port [ 901.538221] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_rules [ 901.538985] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_members [ 901.538985] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7da37ce8-9285-497e-b115-147a6ebce819 with Priority: HIGHEST for action port [ 901.538985] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e245eb8-32e9-4599-974c-039ad69ab827',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.540484] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.540602] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.540602] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.540798] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.540882] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.543982] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.547010] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.547293] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-7da37ce8-9285-497e-b115-147a6ebce819 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.547405] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7da37ce8-9285-497e-b115-147a6ebce819" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.547540] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7da37ce8-9285-497e-b115-147a6ebce819" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.547683] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7da37ce8-9285-497e-b115-147a6ebce819" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.547780] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7da37ce8-9285-497e-b115-147a6ebce819',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.041416] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.041582] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.041705] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.041950] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.042054] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.042266] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e245eb8-32e9-4599-974c-039ad69ab827 is going to be updated. [ 902.050114] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7da37ce8-9285-497e-b115-147a6ebce819 with status ACTIVE [ 902.050451] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.050709] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.050867] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.051147] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.051322] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.052665] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.052665] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.052665] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.052665] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.052665] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.052665] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.052665] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.052665] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.052665] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.052665] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.052665] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7da37ce8-9285-497e-b115-147a6ebce819 is going to be updated. [ 902.053739] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.053852] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.070802] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.070965] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.071030] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.073256] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.073256] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.073256] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7da37ce8-9285-497e-b115-147a6ebce819" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.074057] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.074183] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.074252] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.074429] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.074548] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.083934] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e245eb8-32e9-4599-974c-039ad69ab827 in Status: IN_PROGRESS for 2s [ 902.895316] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: SUCCESS [ 902.895553] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.895725] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.895958] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.896148] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.896269] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.896354] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.896491] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.896572] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.896668] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.986523] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e0a8aca-d575-4597-b049-0d3d263dac47 in Status: SUCCESS [ 902.986723] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e0a8aca-d575-4597-b049-0d3d263dac47 deletion is rescheduled due to dependency. [ 902.986841] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e0a8aca-d575-4597-b049-0d3d263dac47" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.399954] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.907456] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.918785] env[70764]: INFO networking_nsxv3.common.synchronization [req-aa1085bc-9271-4aa8-b37e-1d16aaba13c3 req-910b8aad-f951-4ce8-91dc-796dcde3a0bd tempest-ImagesOneServerNegativeTestJSON-1318507346 tempest-ImagesOneServerNegativeTestJSON-1318507346-project-member] Enqueued Resource ID: 2a93825c-656b-4f3f-b946-3346edd746bf with Priority: HIGHEST for action security_group_members [ 903.919347] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a93825c-656b-4f3f-b946-3346edd746bf with Priority: HIGHEST for action security_group_members [ 903.919670] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a93825c-656b-4f3f-b946-3346edd746bf taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.919792] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.919857] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.920805] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.920922] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.921044] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.921108] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.921279] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.921366] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.921737] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a93825c-656b-4f3f-b946-3346edd746bf',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.094426] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e245eb8-32e9-4599-974c-039ad69ab827 in Status: SUCCESS [ 904.095131] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.411862] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.412434] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.412584] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.412982] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.413170] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.413464] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8f5efec-a14e-4be6-8add-7b35a995c982 is going to be updated. [ 904.432607] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.432607] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.432607] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.432607] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.432607] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.432607] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.432607] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.432607] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.432607] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.432607] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.432607] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a93825c-656b-4f3f-b946-3346edd746bf is going to be updated. [ 904.461410] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.461592] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.461697] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.461931] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.462090] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.467215] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.467426] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.467517] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.467707] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.467855] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.477932] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a93825c-656b-4f3f-b946-3346edd746bf in Status: IN_PROGRESS for 2s [ 904.478660] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: IN_PROGRESS for 2s [ 906.489233] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a93825c-656b-4f3f-b946-3346edd746bf in Status: SUCCESS [ 906.489613] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a93825c-656b-4f3f-b946-3346edd746bf deletion is rescheduled due to dependency. [ 906.489613] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.490210] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: SUCCESS [ 906.490436] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.490527] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.490754] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.490940] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.491059] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.491129] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.491502] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.491502] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.491502] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.491645] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.994109] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.994841] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.994841] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.994841] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.994841] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.994841] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.995107] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.995107] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.995107] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.995201] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.995363] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.995411] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.995460] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.995593] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.995726] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.995813] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.995868] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.995999] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.996085] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.996163] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.996252] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.498580] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f8f5efec-a14e-4be6-8add-7b35a995c982: rpc.has_security_group_logging(os_id): False [ 907.516143] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.516304] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.516369] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.516608] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.516724] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.516970] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.517092] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.517152] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.517301] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.517412] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.517580] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.517662] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.517759] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.517865] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.517940] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.518145] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.518458] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.518524] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.518668] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.518765] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.518837] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8f5efec-a14e-4be6-8add-7b35a995c982 is going to be updated. [ 907.607039] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.607245] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.607333] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.607727] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.607986] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.624064] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: IN_PROGRESS for 2s [ 908.920826] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 908.920826] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 909.113636] env[70764]: INFO networking_nsxv3.common.synchronization [req-7ea02619-37a4-44dd-a991-7678c8c9bd94 req-1cee6393-a265-4f4a-b8ea-c34e14c523c3 tempest-ServersAdminTestJSON-868847224 tempest-ServersAdminTestJSON-868847224-project-member] Enqueued Resource ID: 5e9c0048-237b-4cab-86e0-e56dce546daa with Priority: HIGHEST for action security_group_members [ 909.114324] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e9c0048-237b-4cab-86e0-e56dce546daa with Priority: HIGHEST for action security_group_members [ 909.114697] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e9c0048-237b-4cab-86e0-e56dce546daa taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.114814] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.114879] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.119248] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.119456] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.119670] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.119670] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.119823] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.119927] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.120064] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e9c0048-237b-4cab-86e0-e56dce546daa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.622963] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.623169] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.623257] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.623496] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.623602] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.623982] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.623982] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.623982] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.624679] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.624679] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.624679] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e9c0048-237b-4cab-86e0-e56dce546daa is going to be updated. [ 909.644989] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: SUCCESS [ 909.645251] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.653783] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.653947] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.654108] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.654388] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.654570] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.662591] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e9c0048-237b-4cab-86e0-e56dce546daa in Status: IN_PROGRESS for 2s [ 910.888694] env[70764]: INFO networking_nsxv3.common.synchronization [req-3c0838dc-a615-4eb4-bd01-8f3729ea1f89 req-87f1557e-5598-4c42-a6f3-df3de53bc3d2 tempest-ServerRescueTestJSON-867055778 tempest-ServerRescueTestJSON-867055778-project-member] Enqueued Resource ID: ffefe95f-97fb-4dd1-96fc-f444084d7691 with Priority: HIGHEST for action security_group_members [ 910.894330] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffefe95f-97fb-4dd1-96fc-f444084d7691 with Priority: HIGHEST for action security_group_members [ 910.894330] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffefe95f-97fb-4dd1-96fc-f444084d7691 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.894330] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.894330] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.894330] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.894330] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.894330] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.894330] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.894330] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.894330] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.894894] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ffefe95f-97fb-4dd1-96fc-f444084d7691',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.400151] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.400151] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.400151] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.400151] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.400151] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.400571] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.401506] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.401506] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.401506] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.401774] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.401851] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffefe95f-97fb-4dd1-96fc-f444084d7691 is going to be updated. [ 911.427400] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.427544] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.427616] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.427820] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.427952] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.443017] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffefe95f-97fb-4dd1-96fc-f444084d7691 in Status: IN_PROGRESS for 2s [ 911.674869] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e9c0048-237b-4cab-86e0-e56dce546daa in Status: SUCCESS [ 911.675446] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e9c0048-237b-4cab-86e0-e56dce546daa deletion is rescheduled due to dependency. [ 911.675446] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.013906] env[70764]: INFO networking_nsxv3.common.synchronization [req-09817de4-f1b3-4390-a5b3-47b75a5df180 req-bfe44cef-284b-4e07-971f-7323836ceabd tempest-ServerDiskConfigTestJSON-1914051978 tempest-ServerDiskConfigTestJSON-1914051978-project-member] Enqueued Resource ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 with Priority: HIGHEST for action security_group_members [ 912.014495] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 with Priority: HIGHEST for action security_group_members [ 912.014863] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-56646d46-eb79-4ebc-a596-a5a17716f8e4 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.015565] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.015565] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.015565] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.015565] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.015565] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.016946] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.016946] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.016946] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.016946] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56646d46-eb79-4ebc-a596-a5a17716f8e4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.518845] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.519032] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.519110] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.519371] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.519471] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.519700] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.519814] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.519941] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.520035] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.520099] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.520211] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 is going to be updated. [ 912.559861] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.560072] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.560072] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.560400] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.560482] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.569418] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 in Status: IN_PROGRESS for 2s [ 913.452535] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffefe95f-97fb-4dd1-96fc-f444084d7691 in Status: SUCCESS [ 913.452535] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffefe95f-97fb-4dd1-96fc-f444084d7691 deletion is rescheduled due to dependency. [ 913.452535] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.743763] env[70764]: INFO networking_nsxv3.common.synchronization [req-99569e93-a201-41f9-ba5e-135620bdae22 req-d614b30f-2893-4eb1-88f2-c003e5555b01 tempest-AttachInterfacesV270Test-1365814598 tempest-AttachInterfacesV270Test-1365814598-project-member] Enqueued Resource ID: b963e01f-1537-47b8-8841-14ab14f97bf8 with Priority: HIGHEST for action security_group_members [ 913.743763] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b963e01f-1537-47b8-8841-14ab14f97bf8 with Priority: HIGHEST for action security_group_members [ 913.743763] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-b963e01f-1537-47b8-8841-14ab14f97bf8 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.744697] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b963e01f-1537-47b8-8841-14ab14f97bf8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.744932] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b963e01f-1537-47b8-8841-14ab14f97bf8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.746764] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b963e01f-1537-47b8-8841-14ab14f97bf8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.746764] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.746764] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.746764] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.746764] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.746764] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.746764] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b963e01f-1537-47b8-8841-14ab14f97bf8',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.248585] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.248674] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.248760] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.248983] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.249115] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.249310] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.249413] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.249483] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.249675] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.249749] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.249861] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b963e01f-1537-47b8-8841-14ab14f97bf8 already deleted. [ 914.249985] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b963e01f-1537-47b8-8841-14ab14f97bf8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.269855] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-18 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.269855] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.270077] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.270275] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.271945] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.271945] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.272159] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.273120] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.273120] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.273120] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 914.273120] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 914.273120] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 914.273120] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 914.273120] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 914.273359] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 914.273422] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 914.291089] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 914.291273] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 914.291427] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 914.291602] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-18" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.292062] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-247c3708-4509-4d67-bc79-32181ef9bbdd taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.292251] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-247c3708-4509-4d67-bc79-32181ef9bbdd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.292374] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-247c3708-4509-4d67-bc79-32181ef9bbdd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.292678] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-247c3708-4509-4d67-bc79-32181ef9bbdd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.292820] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('247c3708-4509-4d67-bc79-32181ef9bbdd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.579386] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 in Status: SUCCESS [ 914.579703] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 deletion is rescheduled due to dependency. [ 914.579703] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.796364] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.796608] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.796741] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.797046] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.797204] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.797364] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 247c3708-4509-4d67-bc79-32181ef9bbdd not found, creating... [ 914.797632] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.797795] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.797916] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.798168] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.798303] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.799021] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.799021] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.799021] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.799219] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.799219] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.799315] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 247c3708-4509-4d67-bc79-32181ef9bbdd is going to be created. [ 914.817107] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.817357] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.817429] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.817673] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.817926] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.818128] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-247c3708-4509-4d67-bc79-32181ef9bbdd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.695289] env[70764]: INFO networking_nsxv3.common.synchronization [req-99569e93-a201-41f9-ba5e-135620bdae22 req-16ac3dcc-f822-4af6-b88f-e512f204a010 service nova] Enqueued Resource ID: b963e01f-1537-47b8-8841-14ab14f97bf8 with Priority: HIGHEST for action security_group_rules [ 915.695572] env[70764]: INFO networking_nsxv3.common.synchronization [req-99569e93-a201-41f9-ba5e-135620bdae22 req-16ac3dcc-f822-4af6-b88f-e512f204a010 service nova] Enqueued Resource ID: b963e01f-1537-47b8-8841-14ab14f97bf8 with Priority: HIGHEST for action security_group_members [ 915.695740] env[70764]: INFO networking_nsxv3.common.synchronization [req-99569e93-a201-41f9-ba5e-135620bdae22 req-16ac3dcc-f822-4af6-b88f-e512f204a010 service nova] Enqueued Resource ID: 247c3708-4509-4d67-bc79-32181ef9bbdd with Priority: HIGHEST for action port [ 915.696301] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b963e01f-1537-47b8-8841-14ab14f97bf8 with Priority: HIGHEST for action security_group_rules [ 915.696475] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b963e01f-1537-47b8-8841-14ab14f97bf8 with Priority: HIGHEST for action security_group_members [ 915.696621] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 247c3708-4509-4d67-bc79-32181ef9bbdd with Priority: HIGHEST for action port [ 915.696914] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b963e01f-1537-47b8-8841-14ab14f97bf8 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.698083] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b963e01f-1537-47b8-8841-14ab14f97bf8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.699111] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b963e01f-1537-47b8-8841-14ab14f97bf8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.699111] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b963e01f-1537-47b8-8841-14ab14f97bf8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.699111] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b963e01f-1537-47b8-8841-14ab14f97bf8',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.700552] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-b963e01f-1537-47b8-8841-14ab14f97bf8 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.700552] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b963e01f-1537-47b8-8841-14ab14f97bf8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.700552] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b963e01f-1537-47b8-8841-14ab14f97bf8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.700715] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b963e01f-1537-47b8-8841-14ab14f97bf8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.701298] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.701415] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.701482] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.701775] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.701807] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.701907] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b963e01f-1537-47b8-8841-14ab14f97bf8',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.704372] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-247c3708-4509-4d67-bc79-32181ef9bbdd taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.704550] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-247c3708-4509-4d67-bc79-32181ef9bbdd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.704550] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-247c3708-4509-4d67-bc79-32181ef9bbdd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.704705] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-247c3708-4509-4d67-bc79-32181ef9bbdd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.704790] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('247c3708-4509-4d67-bc79-32181ef9bbdd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.201390] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-b963e01f-1537-47b8-8841-14ab14f97bf8 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.201390] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b963e01f-1537-47b8-8841-14ab14f97bf8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.205445] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b963e01f-1537-47b8-8841-14ab14f97bf8',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.210025] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 247c3708-4509-4d67-bc79-32181ef9bbdd with status ACTIVE [ 916.210025] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.210025] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.210025] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.210025] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.210025] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.210025] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.210025] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.210025] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.210025] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.210025] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.210025] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.210025] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.210025] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.210025] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.210025] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.210025] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 247c3708-4509-4d67-bc79-32181ef9bbdd is going to be updated. [ 916.228088] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.228242] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.228312] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.228517] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.228649] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.228806] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-247c3708-4509-4d67-bc79-32181ef9bbdd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.330024] env[70764]: INFO networking_nsxv3.common.synchronization [req-39dd4861-e244-4d6b-a446-782c6c73301b req-a3439840-9eaa-438d-ac60-71e6b58036df tempest-DeleteServersTestJSON-1788501793 tempest-DeleteServersTestJSON-1788501793-project-member] Enqueued Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGHEST for action security_group_members [ 916.330267] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGHEST for action security_group_members [ 916.331144] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-3379805b-13ae-4057-9511-570e8b3c2437 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.331144] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.331144] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.331144] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.331144] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.331606] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.331606] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.331606] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.331606] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.331606] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3379805b-13ae-4057-9511-570e8b3c2437',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.605852] env[70764]: INFO networking_nsxv3.common.synchronization [req-88fb113f-2556-4f0b-a851-8b700bda702f req-fb85ff0b-b602-4294-af96-94d8f1976a3b tempest-ServersTestBootFromVolume-2146126926 tempest-ServersTestBootFromVolume-2146126926-project-member] Enqueued Resource ID: dffe2468-a89e-4c09-9b45-a73f1d41f82e with Priority: HIGHEST for action security_group_members [ 916.606815] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dffe2468-a89e-4c09-9b45-a73f1d41f82e with Priority: HIGHEST for action security_group_members [ 916.606815] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-dffe2468-a89e-4c09-9b45-a73f1d41f82e taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.606971] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dffe2468-a89e-4c09-9b45-a73f1d41f82e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.606971] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dffe2468-a89e-4c09-9b45-a73f1d41f82e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.608022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dffe2468-a89e-4c09-9b45-a73f1d41f82e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.608268] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.608346] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.608346] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.609265] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.609394] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.609493] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dffe2468-a89e-4c09-9b45-a73f1d41f82e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.709900] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b963e01f-1537-47b8-8841-14ab14f97bf8',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.759214] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-974 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.759422] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-974" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.759553] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-974" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.759866] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-974" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.760159] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.760325] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.760454] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.760663] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.760809] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.763811] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 916.764040] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 916.764198] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 916.764288] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 916.764415] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 916.764518] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 916.764657] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 916.782540] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 916.782540] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 916.782540] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 916.782540] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-974" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.782880] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-2a969626-2404-444c-a941-e970efefa422 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.783609] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-2a969626-2404-444c-a941-e970efefa422" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.783609] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-2a969626-2404-444c-a941-e970efefa422" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.783609] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-2a969626-2404-444c-a941-e970efefa422" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.783770] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a969626-2404-444c-a941-e970efefa422',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.833932] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.834113] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.834183] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.834391] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.834481] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.834681] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.834898] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.834968] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.835232] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.835232] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.835318] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3379805b-13ae-4057-9511-570e8b3c2437 is going to be updated. [ 916.874090] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.874090] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.874090] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.874090] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.874090] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.879987] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3379805b-13ae-4057-9511-570e8b3c2437 in Status: IN_PROGRESS for 2s [ 917.112414] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.112583] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.112641] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.112933] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.133284] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.133560] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.133683] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.133752] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.134031] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.134133] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.134224] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dffe2468-a89e-4c09-9b45-a73f1d41f82e is going to be updated. [ 917.172714] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.172929] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.172929] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.173294] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.173294] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.181352] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dffe2468-a89e-4c09-9b45-a73f1d41f82e in Status: IN_PROGRESS for 2s [ 917.211988] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.212177] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.212234] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.212451] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.212543] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.212644] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b963e01f-1537-47b8-8841-14ab14f97bf8 is going to be created. [ 917.250171] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.250327] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.250401] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.250612] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.250770] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.261236] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b963e01f-1537-47b8-8841-14ab14f97bf8 in Status: UNINITIALIZED for 2s [ 917.286893] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.287081] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.287219] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.287713] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.287713] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.287827] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 2a969626-2404-444c-a941-e970efefa422 not found, creating... [ 917.288206] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.288395] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.288521] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.288779] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.288872] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.289174] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.289334] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.289452] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.289667] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.289797] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.289937] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 2a969626-2404-444c-a941-e970efefa422 is going to be created. [ 917.312321] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.312553] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.312715] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.313016] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.313285] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.313509] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-2a969626-2404-444c-a941-e970efefa422" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.059883] env[70764]: INFO networking_nsxv3.common.synchronization [req-39dd4861-e244-4d6b-a446-782c6c73301b req-8e1bbe02-c4ba-44bf-9729-5a2ca5ffa40d service nova] Enqueued Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGHEST for action security_group_rules [ 918.060174] env[70764]: INFO networking_nsxv3.common.synchronization [req-39dd4861-e244-4d6b-a446-782c6c73301b req-8e1bbe02-c4ba-44bf-9729-5a2ca5ffa40d service nova] Enqueued Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGHEST for action security_group_members [ 918.060431] env[70764]: INFO networking_nsxv3.common.synchronization [req-39dd4861-e244-4d6b-a446-782c6c73301b req-8e1bbe02-c4ba-44bf-9729-5a2ca5ffa40d service nova] Enqueued Resource ID: 2a969626-2404-444c-a941-e970efefa422 with Priority: HIGHEST for action port [ 918.060710] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGHEST for action security_group_rules [ 918.061074] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGHEST for action security_group_members [ 918.061074] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a969626-2404-444c-a941-e970efefa422 with Priority: HIGHEST for action port [ 918.061320] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3379805b-13ae-4057-9511-570e8b3c2437 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.061320] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.061435] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.061567] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.061651] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3379805b-13ae-4057-9511-570e8b3c2437',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.062496] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-3379805b-13ae-4057-9511-570e8b3c2437 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.062684] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.062856] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a969626-2404-444c-a941-e970efefa422 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.062928] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a969626-2404-444c-a941-e970efefa422" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.062928] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a969626-2404-444c-a941-e970efefa422" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.063100] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a969626-2404-444c-a941-e970efefa422" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.063198] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a969626-2404-444c-a941-e970efefa422',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.567498] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-3379805b-13ae-4057-9511-570e8b3c2437 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.567657] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.567816] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2a969626-2404-444c-a941-e970efefa422 with status ACTIVE [ 918.567980] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.568098] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.568171] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.568369] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.568459] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.568627] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.568721] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.568782] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.568926] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.569125] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.569193] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.569285] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.569330] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.569470] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.569539] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.569639] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2a969626-2404-444c-a941-e970efefa422 is going to be updated. [ 918.588294] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.588438] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.588486] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.588655] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.588779] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.588935] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a969626-2404-444c-a941-e970efefa422" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.889039] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3379805b-13ae-4057-9511-570e8b3c2437 in Status: SUCCESS [ 918.889242] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3379805b-13ae-4057-9511-570e8b3c2437 deletion is rescheduled due to dependency. [ 918.889359] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.889520] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.889915] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.890148] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.890279] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.890349] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.890527] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.890612] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.890711] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3379805b-13ae-4057-9511-570e8b3c2437',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.196129] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dffe2468-a89e-4c09-9b45-a73f1d41f82e in Status: SUCCESS [ 919.196477] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dffe2468-a89e-4c09-9b45-a73f1d41f82e deletion is rescheduled due to dependency. [ 919.196477] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dffe2468-a89e-4c09-9b45-a73f1d41f82e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.271252] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b963e01f-1537-47b8-8841-14ab14f97bf8 in Status: SUCCESS [ 919.271542] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b963e01f-1537-47b8-8841-14ab14f97bf8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.271681] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b963e01f-1537-47b8-8841-14ab14f97bf8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.271876] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b963e01f-1537-47b8-8841-14ab14f97bf8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.272107] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.272207] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.272267] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.272493] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.272584] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.272683] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b963e01f-1537-47b8-8841-14ab14f97bf8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.272785] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b963e01f-1537-47b8-8841-14ab14f97bf8',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.393481] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3379805b-13ae-4057-9511-570e8b3c2437',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.776644] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-b963e01f-1537-47b8-8841-14ab14f97bf8 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.776833] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b963e01f-1537-47b8-8841-14ab14f97bf8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.776924] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b963e01f-1537-47b8-8841-14ab14f97bf8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.777222] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b963e01f-1537-47b8-8841-14ab14f97bf8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.777419] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.777528] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.777591] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.777784] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.777892] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.777985] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b963e01f-1537-47b8-8841-14ab14f97bf8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.778160] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-b963e01f-1537-47b8-8841-14ab14f97bf8 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.778254] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b963e01f-1537-47b8-8841-14ab14f97bf8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.778314] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b963e01f-1537-47b8-8841-14ab14f97bf8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.778457] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b963e01f-1537-47b8-8841-14ab14f97bf8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.778592] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.778695] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.778768] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.778907] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.778982] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.779113] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b963e01f-1537-47b8-8841-14ab14f97bf8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.779205] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b963e01f-1537-47b8-8841-14ab14f97bf8',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.896827] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3379805b-13ae-4057-9511-570e8b3c2437',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.281707] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b963e01f-1537-47b8-8841-14ab14f97bf8: rpc.has_security_group_logging(os_id): False [ 920.298093] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.298252] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.298325] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.298528] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.298618] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.298806] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.298907] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.298968] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.299133] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.299205] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.299396] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.299485] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.299542] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.299713] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.299788] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.299983] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.300189] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.300250] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.300391] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.300459] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.300546] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b963e01f-1537-47b8-8841-14ab14f97bf8 is going to be created. [ 920.360861] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.361285] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.361285] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.361368] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.361539] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.371469] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b963e01f-1537-47b8-8841-14ab14f97bf8 in Status: IN_PROGRESS for 2s [ 920.399163] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.399521] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.399614] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.399863] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.399961] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.400083] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3379805b-13ae-4057-9511-570e8b3c2437 is going to be updated. [ 920.431617] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.431884] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.432032] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.432367] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.432602] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.448152] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3379805b-13ae-4057-9511-570e8b3c2437 in Status: IN_PROGRESS for 2s [ 920.769326] env[70764]: INFO networking_nsxv3.common.synchronization [req-89cac81b-09e9-4b1c-ae9b-ba2037cab162 req-08f8a59b-13bc-46f7-9bfd-0848a945e0f2 tempest-ListServerFiltersTestJSON-1936062786 tempest-ListServerFiltersTestJSON-1936062786-project-member] Enqueued Resource ID: 9e245eb8-32e9-4599-974c-039ad69ab827 with Priority: HIGHEST for action security_group_members [ 920.769447] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e245eb8-32e9-4599-974c-039ad69ab827 with Priority: HIGHEST for action security_group_members [ 920.772604] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e245eb8-32e9-4599-974c-039ad69ab827 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.773616] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.773721] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.776408] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.776408] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.776408] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.776408] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.776408] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.776408] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.776408] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e245eb8-32e9-4599-974c-039ad69ab827',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.276909] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.277085] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.277155] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.277432] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.278015] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.278015] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.278015] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.278015] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.278193] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.278193] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.278266] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e245eb8-32e9-4599-974c-039ad69ab827 is going to be updated. [ 921.304216] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.304479] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.304479] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.304639] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.304818] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.314601] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e245eb8-32e9-4599-974c-039ad69ab827 in Status: IN_PROGRESS for 2s [ 922.385202] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b963e01f-1537-47b8-8841-14ab14f97bf8 in Status: SUCCESS [ 922.385511] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b963e01f-1537-47b8-8841-14ab14f97bf8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.455767] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3379805b-13ae-4057-9511-570e8b3c2437 in Status: SUCCESS [ 922.456084] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.456353] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.456605] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.456870] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.457015] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.457090] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.457262] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.457341] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.457427] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.457524] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3379805b-13ae-4057-9511-570e8b3c2437',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.963029] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-3379805b-13ae-4057-9511-570e8b3c2437 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.963029] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.963029] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.963029] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.963029] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.963029] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.963029] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.963029] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.963029] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.963029] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.963029] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-3379805b-13ae-4057-9511-570e8b3c2437 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.963029] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.963029] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.963029] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.963029] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.963029] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.963612] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.963612] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.963612] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.963612] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.963612] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3379805b-13ae-4057-9511-570e8b3c2437',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.106221] env[70764]: INFO networking_nsxv3.common.synchronization [req-c7f3edec-e1bf-4c49-91f4-c1fc0cc14d5c req-d1c43997-8998-4c1e-834e-c634fef5ffe0 tempest-ServersTestFqdnHostnames-964324386 tempest-ServersTestFqdnHostnames-964324386-project-member] Enqueued Resource ID: b221064c-6962-44ea-989e-cf4546ea92ab with Priority: HIGHEST for action security_group_members [ 923.106898] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b221064c-6962-44ea-989e-cf4546ea92ab with Priority: HIGHEST for action security_group_members [ 923.108138] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-b221064c-6962-44ea-989e-cf4546ea92ab taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.108138] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b221064c-6962-44ea-989e-cf4546ea92ab" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.108138] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b221064c-6962-44ea-989e-cf4546ea92ab" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.108330] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b221064c-6962-44ea-989e-cf4546ea92ab" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.108568] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.108777] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.108925] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.109178] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.109344] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.109503] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b221064c-6962-44ea-989e-cf4546ea92ab',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.324492] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e245eb8-32e9-4599-974c-039ad69ab827 in Status: SUCCESS [ 923.324877] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e245eb8-32e9-4599-974c-039ad69ab827 deletion is rescheduled due to dependency. [ 923.324877] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.465823] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3379805b-13ae-4057-9511-570e8b3c2437: rpc.has_security_group_logging(os_id): False [ 923.482122] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.482390] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.482390] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.482599] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.482689] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.482929] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.483033] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.483099] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.483257] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.483314] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.483495] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.483625] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.483713] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.483882] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.483980] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.486502] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.487913] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.487913] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.487913] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.487913] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.487913] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3379805b-13ae-4057-9511-570e8b3c2437 is going to be updated. [ 923.553591] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.553591] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.554121] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.554121] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.554121] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.569585] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3379805b-13ae-4057-9511-570e8b3c2437 in Status: IN_PROGRESS for 2s [ 923.614680] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.614680] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.614680] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.614680] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.614680] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.614680] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.614680] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.614680] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.614680] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.614680] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.614680] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b221064c-6962-44ea-989e-cf4546ea92ab is going to be updated. [ 923.646458] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.646626] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.646696] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.646906] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.647053] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.654903] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b221064c-6962-44ea-989e-cf4546ea92ab in Status: IN_PROGRESS for 2s [ 925.585215] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3379805b-13ae-4057-9511-570e8b3c2437 in Status: SUCCESS [ 925.585510] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.664295] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b221064c-6962-44ea-989e-cf4546ea92ab in Status: SUCCESS [ 925.664512] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b221064c-6962-44ea-989e-cf4546ea92ab deletion is rescheduled due to dependency. [ 925.664620] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b221064c-6962-44ea-989e-cf4546ea92ab" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.539151] env[70764]: INFO networking_nsxv3.common.synchronization [req-e46edd01-0e42-484e-bbbc-d35289b549bf req-a4932ad9-d528-48ff-bd6c-ba77c3df3cbd tempest-AttachVolumeNegativeTest-232785497 tempest-AttachVolumeNegativeTest-232785497-project-member] Enqueued Resource ID: 837be310-7b7c-4ed0-9877-3473fe63d929 with Priority: HIGHEST for action security_group_members [ 927.539707] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 837be310-7b7c-4ed0-9877-3473fe63d929 with Priority: HIGHEST for action security_group_members [ 927.540036] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-837be310-7b7c-4ed0-9877-3473fe63d929 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.540165] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-837be310-7b7c-4ed0-9877-3473fe63d929" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.540233] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-837be310-7b7c-4ed0-9877-3473fe63d929" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.540476] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-837be310-7b7c-4ed0-9877-3473fe63d929" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.540591] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.540657] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.540722] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.540866] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.540949] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.541167] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('837be310-7b7c-4ed0-9877-3473fe63d929',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.043945] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.043945] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.044250] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.044250] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.044354] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.044574] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.044707] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.044813] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.045051] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.045144] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.045236] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 837be310-7b7c-4ed0-9877-3473fe63d929 is going to be updated. [ 928.074331] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.074331] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.074542] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.074602] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.074712] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.084775] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 837be310-7b7c-4ed0-9877-3473fe63d929 in Status: IN_PROGRESS for 2s [ 929.641636] env[70764]: INFO networking_nsxv3.common.synchronization [req-4ddbfb23-e013-453d-a2e5-44eb263a25c8 req-63c80342-2061-4c54-9c18-07d7fa41d7e3 tempest-AttachInterfacesV270Test-1365814598 tempest-AttachInterfacesV270Test-1365814598-project-member] Enqueued Resource ID: b963e01f-1537-47b8-8841-14ab14f97bf8 with Priority: HIGHEST for action security_group_members [ 929.642313] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b963e01f-1537-47b8-8841-14ab14f97bf8 with Priority: HIGHEST for action security_group_members [ 929.642616] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-b963e01f-1537-47b8-8841-14ab14f97bf8 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.642743] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b963e01f-1537-47b8-8841-14ab14f97bf8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.642802] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b963e01f-1537-47b8-8841-14ab14f97bf8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.643019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b963e01f-1537-47b8-8841-14ab14f97bf8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.643176] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.643274] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.643337] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.643512] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.643559] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.643656] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b963e01f-1537-47b8-8841-14ab14f97bf8',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.095046] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 837be310-7b7c-4ed0-9877-3473fe63d929 in Status: SUCCESS [ 930.095249] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 837be310-7b7c-4ed0-9877-3473fe63d929 deletion is rescheduled due to dependency. [ 930.095364] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-837be310-7b7c-4ed0-9877-3473fe63d929" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.118859] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-175 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.119100] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-175" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.119242] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-175" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.119516] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-175" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.119810] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.119978] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.120231] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.120552] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.120744] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.121032] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 930.121148] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 930.121286] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 930.121424] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 930.121659] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 930.121849] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 930.122026] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 930.141106] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 930.141398] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 930.141555] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 930.141899] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-175" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.142285] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-4cf0ffec-9392-4bbb-a4e8-03e4ea2efbb0 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.142541] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-4cf0ffec-9392-4bbb-a4e8-03e4ea2efbb0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.142726] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-4cf0ffec-9392-4bbb-a4e8-03e4ea2efbb0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.143956] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-4cf0ffec-9392-4bbb-a4e8-03e4ea2efbb0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.143956] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4cf0ffec-9392-4bbb-a4e8-03e4ea2efbb0',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.148341] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.148474] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.148541] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.148733] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.148824] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.149027] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.149283] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.149372] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.149535] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.149692] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.149805] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b963e01f-1537-47b8-8841-14ab14f97bf8 is going to be updated. [ 930.175689] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.175689] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.175838] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.175909] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.176052] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.184347] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b963e01f-1537-47b8-8841-14ab14f97bf8 in Status: IN_PROGRESS for 2s [ 930.647699] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.648043] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.648043] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.648345] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.648424] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.648826] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.649047] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.649164] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.649406] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.649623] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.650031] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.650205] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.650326] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.650554] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.650768] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.651016] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 4cf0ffec-9392-4bbb-a4e8-03e4ea2efbb0 is going to be updated. [ 930.679333] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.679663] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.679806] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.680128] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.681017] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.681017] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-4cf0ffec-9392-4bbb-a4e8-03e4ea2efbb0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.390633] env[70764]: INFO networking_nsxv3.common.synchronization [req-7081b7fa-3934-49b0-9537-153e16fe5eb8 req-6d0e4d2d-f932-4151-ac6c-52ee9cb66f06 service nova] Enqueued Resource ID: 9c661804-19d8-4b01-b7d8-b4d1885cc85f with Priority: HIGHEST for action security_group_rules [ 931.390633] env[70764]: INFO networking_nsxv3.common.synchronization [req-7081b7fa-3934-49b0-9537-153e16fe5eb8 req-6d0e4d2d-f932-4151-ac6c-52ee9cb66f06 service nova] Enqueued Resource ID: 9c661804-19d8-4b01-b7d8-b4d1885cc85f with Priority: HIGHEST for action security_group_members [ 931.390764] env[70764]: INFO networking_nsxv3.common.synchronization [req-7081b7fa-3934-49b0-9537-153e16fe5eb8 req-6d0e4d2d-f932-4151-ac6c-52ee9cb66f06 service nova] Enqueued Resource ID: 4cf0ffec-9392-4bbb-a4e8-03e4ea2efbb0 with Priority: HIGHEST for action port [ 931.394026] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c661804-19d8-4b01-b7d8-b4d1885cc85f with Priority: HIGHEST for action security_group_rules [ 931.394026] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c661804-19d8-4b01-b7d8-b4d1885cc85f with Priority: HIGHEST for action security_group_members [ 931.394026] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cf0ffec-9392-4bbb-a4e8-03e4ea2efbb0 with Priority: HIGHEST for action port [ 931.394026] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c661804-19d8-4b01-b7d8-b4d1885cc85f taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.394026] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.394026] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.394026] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.394026] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c661804-19d8-4b01-b7d8-b4d1885cc85f',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.394026] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c661804-19d8-4b01-b7d8-b4d1885cc85f taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.394026] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.394026] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.394624] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.394624] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.394624] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.394624] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.394624] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.394624] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.394809] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c661804-19d8-4b01-b7d8-b4d1885cc85f',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.396960] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-4cf0ffec-9392-4bbb-a4e8-03e4ea2efbb0 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.397125] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4cf0ffec-9392-4bbb-a4e8-03e4ea2efbb0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.397201] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4cf0ffec-9392-4bbb-a4e8-03e4ea2efbb0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.397331] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4cf0ffec-9392-4bbb-a4e8-03e4ea2efbb0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.397531] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4cf0ffec-9392-4bbb-a4e8-03e4ea2efbb0',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.899988] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c661804-19d8-4b01-b7d8-b4d1885cc85f taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.900291] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.900373] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9c661804-19d8-4b01-b7d8-b4d1885cc85f',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.901270] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4cf0ffec-9392-4bbb-a4e8-03e4ea2efbb0 with status ACTIVE [ 931.901454] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.901569] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.901627] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.901904] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.901999] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.902186] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.902286] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.902351] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.902507] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.902587] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.902764] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.902879] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.902998] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.903069] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.903149] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.903236] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4cf0ffec-9392-4bbb-a4e8-03e4ea2efbb0 is going to be updated. [ 931.923866] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.924064] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.924166] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.924424] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.924564] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.924723] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4cf0ffec-9392-4bbb-a4e8-03e4ea2efbb0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.202583] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b963e01f-1537-47b8-8841-14ab14f97bf8 in Status: SUCCESS [ 932.202965] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b963e01f-1537-47b8-8841-14ab14f97bf8 deletion is rescheduled due to dependency. [ 932.203193] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b963e01f-1537-47b8-8841-14ab14f97bf8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.404894] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9c661804-19d8-4b01-b7d8-b4d1885cc85f',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.907897] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.908318] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.908318] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.908386] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.908471] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.908574] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c661804-19d8-4b01-b7d8-b4d1885cc85f is going to be updated. [ 932.958844] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.959320] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.959320] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.959320] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.959478] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.968402] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c661804-19d8-4b01-b7d8-b4d1885cc85f in Status: IN_PROGRESS for 2s [ 933.136483] env[70764]: INFO networking_nsxv3.common.synchronization [req-42ae669a-656a-42ee-95b0-055c323d41d0 req-5bb59be0-cd55-4d21-a445-031730194244 tempest-ServersWithSpecificFlavorTestJSON-440557435 tempest-ServersWithSpecificFlavorTestJSON-440557435-project-member] Enqueued Resource ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 with Priority: HIGHEST for action security_group_members [ 933.140408] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 with Priority: HIGHEST for action security_group_members [ 933.140587] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-380030c5-e260-46fb-aa7e-5000c5bc9507 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.140747] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.140819] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.140985] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.141331] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.141331] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.141506] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.141570] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.141637] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.141697] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('380030c5-e260-46fb-aa7e-5000c5bc9507',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.164830] env[70764]: INFO networking_nsxv3.common.synchronization [None req-7f5feb5d-2c54-4540-b655-bd8ec50538f6 None None] Enqueued Resource ID: 15db8485-e891-4712-9094-cb2e42d5860c with Priority: HIGHEST for action port [ 933.165096] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15db8485-e891-4712-9094-cb2e42d5860c with Priority: HIGHEST for action port [ 933.167533] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-15db8485-e891-4712-9094-cb2e42d5860c taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.167752] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15db8485-e891-4712-9094-cb2e42d5860c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.167752] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15db8485-e891-4712-9094-cb2e42d5860c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.168144] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15db8485-e891-4712-9094-cb2e42d5860c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.168144] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15db8485-e891-4712-9094-cb2e42d5860c',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.644673] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.644825] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.644886] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.645131] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.645221] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.649121] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.649247] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.649323] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.649519] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.649598] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.650757] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 is going to be updated. [ 933.671616] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 15db8485-e891-4712-9094-cb2e42d5860c [ 933.674054] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.674054] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.674054] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.674054] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.674054] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.674054] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:15db8485-e891-4712-9094-cb2e42d5860c already deleted. [ 933.674054] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15db8485-e891-4712-9094-cb2e42d5860c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.679490] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.679825] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.680047] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.680456] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.680705] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.688828] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 in Status: IN_PROGRESS for 2s [ 934.211630] env[70764]: INFO networking_nsxv3.common.synchronization [req-6ff8d6fb-b8c7-46fc-93ec-7bebc986f860 req-88383476-ec22-40c8-aa87-7441a5c2b447 tempest-ServersTestJSON-1873194666 tempest-ServersTestJSON-1873194666-project-member] Enqueued Resource ID: 1e8d083b-4d4e-4192-8c53-ff33df47b5e7 with Priority: HIGHEST for action security_group_members [ 934.212575] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e8d083b-4d4e-4192-8c53-ff33df47b5e7 with Priority: HIGHEST for action security_group_members [ 934.212736] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e8d083b-4d4e-4192-8c53-ff33df47b5e7 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.212847] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e8d083b-4d4e-4192-8c53-ff33df47b5e7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.213043] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e8d083b-4d4e-4192-8c53-ff33df47b5e7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.213223] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e8d083b-4d4e-4192-8c53-ff33df47b5e7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.213530] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.213699] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.213775] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.214155] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.214254] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.215866] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e8d083b-4d4e-4192-8c53-ff33df47b5e7',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.717780] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.717964] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.718091] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.718327] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.718466] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.718668] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.718777] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.718850] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.719082] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.719082] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.719204] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e8d083b-4d4e-4192-8c53-ff33df47b5e7 is going to be updated. [ 934.745113] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.745279] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.745348] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.745555] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.745779] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.757023] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e8d083b-4d4e-4192-8c53-ff33df47b5e7 in Status: IN_PROGRESS for 2s [ 934.981111] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c661804-19d8-4b01-b7d8-b4d1885cc85f in Status: SUCCESS [ 934.981244] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.981523] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.981598] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.981800] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.981938] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.981999] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.982182] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.982263] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.982349] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.982437] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9c661804-19d8-4b01-b7d8-b4d1885cc85f',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.442938] env[70764]: INFO networking_nsxv3.common.synchronization [None req-94b90d94-7ce2-404d-a0a2-525b0abfd5f8 None None] Enqueued Resource ID: 70acbc56-7128-43e6-b1df-c20790fe9e90 with Priority: HIGHEST for action port [ 935.443481] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70acbc56-7128-43e6-b1df-c20790fe9e90 with Priority: HIGHEST for action port [ 935.443827] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-70acbc56-7128-43e6-b1df-c20790fe9e90 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.445661] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70acbc56-7128-43e6-b1df-c20790fe9e90" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.445766] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70acbc56-7128-43e6-b1df-c20790fe9e90" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.446363] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70acbc56-7128-43e6-b1df-c20790fe9e90" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.447356] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70acbc56-7128-43e6-b1df-c20790fe9e90',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.489336] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9c661804-19d8-4b01-b7d8-b4d1885cc85f',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.700969] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 in Status: SUCCESS [ 935.701185] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 deletion is rescheduled due to dependency. [ 935.701302] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.952355] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 70acbc56-7128-43e6-b1df-c20790fe9e90 [ 935.952648] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.952842] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.952945] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.953317] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.953441] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.953546] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:70acbc56-7128-43e6-b1df-c20790fe9e90 already deleted. [ 935.953628] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70acbc56-7128-43e6-b1df-c20790fe9e90" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.994755] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9c661804-19d8-4b01-b7d8-b4d1885cc85f: rpc.has_security_group_logging(os_id): False [ 936.014846] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.015105] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.015105] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.015315] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.015427] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.015706] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.015797] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.015865] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.016050] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.016118] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.016224] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c661804-19d8-4b01-b7d8-b4d1885cc85f is going to be updated. [ 936.081653] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.081879] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.081972] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.082188] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.082342] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.095782] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c661804-19d8-4b01-b7d8-b4d1885cc85f in Status: IN_PROGRESS for 2s [ 936.767701] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e8d083b-4d4e-4192-8c53-ff33df47b5e7 in Status: SUCCESS [ 936.767940] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e8d083b-4d4e-4192-8c53-ff33df47b5e7 deletion is rescheduled due to dependency. [ 936.768045] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e8d083b-4d4e-4192-8c53-ff33df47b5e7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.112197] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c661804-19d8-4b01-b7d8-b4d1885cc85f in Status: SUCCESS [ 938.112502] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.517607] env[70764]: INFO networking_nsxv3.common.synchronization [req-b6da4d22-86cd-4dcc-b0e9-eb1dff52e78b req-190c8310-a3b4-45f9-b1bb-40950ff7229f tempest-ServerDiskConfigTestJSON-1914051978 tempest-ServerDiskConfigTestJSON-1914051978-project-member] Enqueued Resource ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 with Priority: HIGHEST for action security_group_members [ 939.518879] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 with Priority: HIGHEST for action security_group_members [ 939.518879] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-56646d46-eb79-4ebc-a596-a5a17716f8e4 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.518879] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.518879] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.519346] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.520293] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.520456] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.520513] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.522941] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.523043] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.523113] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56646d46-eb79-4ebc-a596-a5a17716f8e4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.029405] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.029405] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.029405] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.029405] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.029405] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.029405] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.029405] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.029405] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.029405] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.029405] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.029405] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 is going to be updated. [ 940.056026] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.056026] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.056026] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.056026] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.056261] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.064261] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 in Status: IN_PROGRESS for 2s [ 940.133221] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-829 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.133427] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-829" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.133555] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-829" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.133830] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-829" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.134294] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.134480] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.134602] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.134915] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.135078] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.135290] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 940.135421] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 940.135962] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 940.135962] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 940.135962] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 940.135962] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 940.136121] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 940.174429] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 940.174429] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 940.174429] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 940.174429] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-829" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.174429] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-608829be-3bbf-4737-85f3-34cfe83e402e taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.174429] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-608829be-3bbf-4737-85f3-34cfe83e402e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.174429] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-608829be-3bbf-4737-85f3-34cfe83e402e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.174429] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-608829be-3bbf-4737-85f3-34cfe83e402e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.174429] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('608829be-3bbf-4737-85f3-34cfe83e402e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.677380] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.677668] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.677823] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.678086] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.678212] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.678382] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 608829be-3bbf-4737-85f3-34cfe83e402e not found, creating... [ 940.678643] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.678835] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.678914] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.679148] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.679286] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.679563] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.679719] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.679838] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.680051] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.680201] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.680344] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 608829be-3bbf-4737-85f3-34cfe83e402e is going to be created. [ 940.701375] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.701590] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.701715] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.702066] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.702296] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.702517] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-608829be-3bbf-4737-85f3-34cfe83e402e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.718530] env[70764]: INFO networking_nsxv3.common.synchronization [req-b6da4d22-86cd-4dcc-b0e9-eb1dff52e78b req-b8e1e6fa-aaf8-47cc-bcdc-2cb8a3a74640 service nova] Enqueued Resource ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 with Priority: HIGHEST for action security_group_rules [ 941.720904] env[70764]: INFO networking_nsxv3.common.synchronization [req-b6da4d22-86cd-4dcc-b0e9-eb1dff52e78b req-b8e1e6fa-aaf8-47cc-bcdc-2cb8a3a74640 service nova] Enqueued Resource ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 with Priority: HIGHEST for action security_group_members [ 941.720904] env[70764]: INFO networking_nsxv3.common.synchronization [req-b6da4d22-86cd-4dcc-b0e9-eb1dff52e78b req-b8e1e6fa-aaf8-47cc-bcdc-2cb8a3a74640 service nova] Enqueued Resource ID: 608829be-3bbf-4737-85f3-34cfe83e402e with Priority: HIGHEST for action port [ 941.720904] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 with Priority: HIGHEST for action security_group_rules [ 941.720904] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 with Priority: HIGHEST for action security_group_members [ 941.720904] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 608829be-3bbf-4737-85f3-34cfe83e402e with Priority: HIGHEST for action port [ 941.721254] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-56646d46-eb79-4ebc-a596-a5a17716f8e4 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.721254] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.721365] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.724487] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.724487] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('56646d46-eb79-4ebc-a596-a5a17716f8e4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.724487] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-56646d46-eb79-4ebc-a596-a5a17716f8e4 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.724487] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.724487] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-608829be-3bbf-4737-85f3-34cfe83e402e taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.724487] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-608829be-3bbf-4737-85f3-34cfe83e402e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.724487] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-608829be-3bbf-4737-85f3-34cfe83e402e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.724487] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-608829be-3bbf-4737-85f3-34cfe83e402e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.724487] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('608829be-3bbf-4737-85f3-34cfe83e402e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.076122] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 in Status: SUCCESS [ 942.076793] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 deletion is rescheduled due to dependency. [ 942.077224] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.077599] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.078010] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.078613] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.078817] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.078910] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.079106] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.079199] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.079301] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56646d46-eb79-4ebc-a596-a5a17716f8e4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.226928] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-56646d46-eb79-4ebc-a596-a5a17716f8e4 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.226928] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.231334] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 608829be-3bbf-4737-85f3-34cfe83e402e with status ACTIVE [ 942.231570] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.231712] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.231833] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.232037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.232191] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.232412] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.233173] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.233365] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.233558] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.233647] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.233872] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.233989] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.234043] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.234168] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.234245] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.234339] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 608829be-3bbf-4737-85f3-34cfe83e402e is going to be updated. [ 942.256016] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.256205] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.256239] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.256452] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.256650] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.257028] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-608829be-3bbf-4737-85f3-34cfe83e402e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.582241] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('56646d46-eb79-4ebc-a596-a5a17716f8e4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.085995] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('56646d46-eb79-4ebc-a596-a5a17716f8e4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.589069] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.589251] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.589348] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.589672] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.589672] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.589843] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 is going to be updated. [ 943.617220] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.617337] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.617394] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.617582] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.617743] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.627898] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 in Status: IN_PROGRESS for 2s [ 943.779289] env[70764]: INFO networking_nsxv3.common.synchronization [None req-178d2ebd-6401-4832-ad63-d980ed6a3f01 None None] Enqueued Resource ID: 8c29d00e-dfa2-478f-ae5d-7cfbf4436087 with Priority: HIGHEST for action port [ 943.780559] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c29d00e-dfa2-478f-ae5d-7cfbf4436087 with Priority: HIGHEST for action port [ 943.780559] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c29d00e-dfa2-478f-ae5d-7cfbf4436087 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.780559] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c29d00e-dfa2-478f-ae5d-7cfbf4436087" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.780559] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c29d00e-dfa2-478f-ae5d-7cfbf4436087" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.780991] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c29d00e-dfa2-478f-ae5d-7cfbf4436087" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.780991] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c29d00e-dfa2-478f-ae5d-7cfbf4436087',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.253445] env[70764]: INFO networking_nsxv3.common.synchronization [req-cda5a9de-f476-4645-a957-db0481e10fc1 req-bc3c7237-0623-43db-855a-0406e26cce9e tempest-DeleteServersTestJSON-1788501793 tempest-DeleteServersTestJSON-1788501793-project-member] Enqueued Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGHEST for action security_group_members [ 944.253963] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGHEST for action security_group_members [ 944.254278] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-3379805b-13ae-4057-9511-570e8b3c2437 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.254398] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.254461] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.254655] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.255982] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.255982] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.255982] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.255982] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.256193] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.256226] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3379805b-13ae-4057-9511-570e8b3c2437',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.292758] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8c29d00e-dfa2-478f-ae5d-7cfbf4436087 [ 944.293011] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.293167] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.293298] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.293473] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.293569] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.293757] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8c29d00e-dfa2-478f-ae5d-7cfbf4436087 already deleted. [ 944.293976] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c29d00e-dfa2-478f-ae5d-7cfbf4436087" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.363811] env[70764]: INFO networking_nsxv3.common.synchronization [req-4b812c59-d547-4921-926f-c892756ceded req-9cc50e4b-73c5-4810-b5c9-5cb80381e161 tempest-ServersTestJSON-88830314 tempest-ServersTestJSON-88830314-project-member] Enqueued Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_members [ 944.367470] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_members [ 944.367470] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.367470] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.367470] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.367470] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.367470] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.367470] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.367470] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.367470] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.367470] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.367470] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.759029] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.759029] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.759029] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.759514] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.765073] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.765073] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.765073] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.765073] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.765073] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.765073] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.765073] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3379805b-13ae-4057-9511-570e8b3c2437 is going to be updated. [ 944.791427] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.791427] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.791427] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.791427] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.791427] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.797247] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3379805b-13ae-4057-9511-570e8b3c2437 in Status: IN_PROGRESS for 2s [ 944.872809] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.376120] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.636983] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 in Status: SUCCESS [ 945.637233] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.637403] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.637636] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.637836] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.637960] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.638043] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.638206] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.638290] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.638377] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.638469] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('56646d46-eb79-4ebc-a596-a5a17716f8e4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.879495] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.879714] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.879767] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.881511] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.881511] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.881511] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8f5efec-a14e-4be6-8add-7b35a995c982 is going to be updated. [ 945.920809] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.921075] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.921448] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.921532] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.922120] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.934481] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-603 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.934693] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-603" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.934826] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-603" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.935118] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-603" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.935375] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.935527] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.939315] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.939315] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.939315] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.939315] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 945.939315] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 945.939315] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 945.939315] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 945.939315] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 945.939315] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 945.939315] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 945.942079] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: IN_PROGRESS for 2s [ 945.959991] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 945.960187] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 945.960409] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 945.960505] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-603" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.960826] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-8ecda220-30f7-4bd5-b24f-19f57e3fb3b3 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.961025] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-8ecda220-30f7-4bd5-b24f-19f57e3fb3b3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.961258] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-8ecda220-30f7-4bd5-b24f-19f57e3fb3b3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.961582] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-8ecda220-30f7-4bd5-b24f-19f57e3fb3b3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.961728] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ecda220-30f7-4bd5-b24f-19f57e3fb3b3',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.141170] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-56646d46-eb79-4ebc-a596-a5a17716f8e4 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.141453] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.141555] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.141829] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.142527] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.142741] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.142850] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.143076] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.143200] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.143324] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.143517] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-56646d46-eb79-4ebc-a596-a5a17716f8e4 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.143648] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.143737] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.143915] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.144113] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.144246] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.145305] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.145482] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.145572] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.145663] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.145759] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('56646d46-eb79-4ebc-a596-a5a17716f8e4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.224646] env[70764]: INFO networking_nsxv3.common.synchronization [req-9f65c2b1-c2bd-41a0-bf72-a7ecebcd9b75 req-93bcb5ec-1da4-4e73-b675-fb63599af131 tempest-MigrationsAdminTest-1035321564 tempest-MigrationsAdminTest-1035321564-project-member] Enqueued Resource ID: 46f17c96-2a3a-415a-8b88-fe6fa64e3db5 with Priority: HIGHEST for action security_group_members [ 946.225177] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46f17c96-2a3a-415a-8b88-fe6fa64e3db5 with Priority: HIGHEST for action security_group_members [ 946.225458] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.225587] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.225686] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.225976] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.226043] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.227275] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.227275] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.227275] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.227275] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.227275] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46f17c96-2a3a-415a-8b88-fe6fa64e3db5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.466065] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.466065] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.466474] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.466507] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.467043] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.467713] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 8ecda220-30f7-4bd5-b24f-19f57e3fb3b3 not found, creating... [ 946.468114] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.471036] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.471036] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.471036] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.471036] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.471036] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.471036] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.471036] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.471036] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.471036] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.471036] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 8ecda220-30f7-4bd5-b24f-19f57e3fb3b3 is going to be created. [ 946.493064] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.493331] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.493886] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.494099] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.494638] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.495189] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-8ecda220-30f7-4bd5-b24f-19f57e3fb3b3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.651718] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 56646d46-eb79-4ebc-a596-a5a17716f8e4: rpc.has_security_group_logging(os_id): False [ 946.670547] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.670709] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.670810] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.671014] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.671130] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.671358] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.671465] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.671522] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.671684] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.671876] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.672140] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.672140] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.672291] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.672345] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.672426] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.672622] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.672844] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.672844] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.673056] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.673056] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.673175] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 is going to be updated. [ 946.731118] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('46f17c96-2a3a-415a-8b88-fe6fa64e3db5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.735057] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.735220] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.735288] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.735500] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.735646] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.750543] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 in Status: IN_PROGRESS for 2s [ 946.809796] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3379805b-13ae-4057-9511-570e8b3c2437 in Status: SUCCESS [ 946.809998] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3379805b-13ae-4057-9511-570e8b3c2437 deletion is rescheduled due to dependency. [ 946.810147] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.225431] env[70764]: INFO networking_nsxv3.common.synchronization [None req-75439f33-c736-46b6-8c39-c3e1dc1ad307 None None] Enqueued Resource ID: 7cc91c7a-6b40-4f6b-bf40-4ddd091c965b with Priority: HIGHEST for action port [ 947.226430] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cc91c7a-6b40-4f6b-bf40-4ddd091c965b with Priority: HIGHEST for action port [ 947.226858] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-7cc91c7a-6b40-4f6b-bf40-4ddd091c965b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.227042] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7cc91c7a-6b40-4f6b-bf40-4ddd091c965b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.227140] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7cc91c7a-6b40-4f6b-bf40-4ddd091c965b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.227483] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7cc91c7a-6b40-4f6b-bf40-4ddd091c965b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.227595] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7cc91c7a-6b40-4f6b-bf40-4ddd091c965b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.238424] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('46f17c96-2a3a-415a-8b88-fe6fa64e3db5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.483421] env[70764]: INFO networking_nsxv3.common.synchronization [req-4b812c59-d547-4921-926f-c892756ceded req-1157fabd-bf17-4316-863b-96ce1f605ed7 service nova] Enqueued Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_rules [ 947.483421] env[70764]: INFO networking_nsxv3.common.synchronization [req-4b812c59-d547-4921-926f-c892756ceded req-1157fabd-bf17-4316-863b-96ce1f605ed7 service nova] Enqueued Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_members [ 947.483421] env[70764]: INFO networking_nsxv3.common.synchronization [req-4b812c59-d547-4921-926f-c892756ceded req-1157fabd-bf17-4316-863b-96ce1f605ed7 service nova] Enqueued Resource ID: 8ecda220-30f7-4bd5-b24f-19f57e3fb3b3 with Priority: HIGHEST for action port [ 947.483421] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_rules [ 947.483421] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_members [ 947.483421] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ecda220-30f7-4bd5-b24f-19f57e3fb3b3 with Priority: HIGHEST for action port [ 947.483421] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.483421] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.483421] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.483421] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.483421] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.485894] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.486235] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.486822] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ecda220-30f7-4bd5-b24f-19f57e3fb3b3 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.487224] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ecda220-30f7-4bd5-b24f-19f57e3fb3b3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.487578] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ecda220-30f7-4bd5-b24f-19f57e3fb3b3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.488712] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ecda220-30f7-4bd5-b24f-19f57e3fb3b3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.488712] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ecda220-30f7-4bd5-b24f-19f57e3fb3b3',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.730335] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7cc91c7a-6b40-4f6b-bf40-4ddd091c965b [ 947.730598] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.730766] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.730863] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.731150] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.731356] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.731487] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7cc91c7a-6b40-4f6b-bf40-4ddd091c965b already deleted. [ 947.731602] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7cc91c7a-6b40-4f6b-bf40-4ddd091c965b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.741329] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.741613] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.741613] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.741831] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.741942] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.742074] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46f17c96-2a3a-415a-8b88-fe6fa64e3db5 is going to be updated. [ 947.789026] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.789026] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.789026] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.789026] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.789026] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.806688] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46f17c96-2a3a-415a-8b88-fe6fa64e3db5 in Status: IN_PROGRESS for 2s [ 947.952703] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: SUCCESS [ 947.966698] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.966698] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.966698] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.966698] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.966698] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.966698] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.966698] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.966698] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.966698] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.990976] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8ecda220-30f7-4bd5-b24f-19f57e3fb3b3 with status ACTIVE [ 947.990976] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.990976] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.990976] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.990976] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.991990] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.991990] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.991990] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.991990] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.992355] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.993569] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.993569] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.993569] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.993569] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.993569] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.993958] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.993958] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8ecda220-30f7-4bd5-b24f-19f57e3fb3b3 is going to be updated. [ 947.994923] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.995024] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.029338] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.029560] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.029639] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.029960] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.029960] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.030114] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ecda220-30f7-4bd5-b24f-19f57e3fb3b3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.458626] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.762394] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 in Status: SUCCESS [ 948.762684] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.961222] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.011389] env[70764]: INFO networking_nsxv3.common.synchronization [req-38c832d4-ebc8-4d59-b503-2eaca751961a req-8462e670-56bc-4884-a640-b0a16fbb6b83 tempest-ImagesTestJSON-1647743380 tempest-ImagesTestJSON-1647743380-project-member] Enqueued Resource ID: 4580d502-1d18-4681-96a4-28ac4e291d69 with Priority: HIGHEST for action security_group_members [ 949.011935] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4580d502-1d18-4681-96a4-28ac4e291d69 with Priority: HIGHEST for action security_group_members [ 949.012247] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4580d502-1d18-4681-96a4-28ac4e291d69 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.012391] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.012485] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.012662] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.012850] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.012975] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.013664] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.013664] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.013664] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.013664] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4580d502-1d18-4681-96a4-28ac4e291d69',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.463964] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.464165] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.464250] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.464797] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.464797] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.464797] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8f5efec-a14e-4be6-8add-7b35a995c982 is going to be updated. [ 949.495773] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.495987] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.495987] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.496229] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.496379] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.512023] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: IN_PROGRESS for 2s [ 949.515967] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4580d502-1d18-4681-96a4-28ac4e291d69',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.627167] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-828 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.627376] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-828" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.627501] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-828" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.627766] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-828" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.629304] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.629304] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.629304] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.629304] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.629304] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.629304] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 949.629304] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 949.629644] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 949.631587] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 949.631723] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 949.631862] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 949.632347] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 949.673270] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 949.673404] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.041 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 949.674831] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 949.674831] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-828" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.674831] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-4e8c0e78-8f1e-41c0-98cb-a6c5b0387b1b taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.674831] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-4e8c0e78-8f1e-41c0-98cb-a6c5b0387b1b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.674831] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-4e8c0e78-8f1e-41c0-98cb-a6c5b0387b1b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.675328] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-4e8c0e78-8f1e-41c0-98cb-a6c5b0387b1b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.675516] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e8c0e78-8f1e-41c0-98cb-a6c5b0387b1b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.820153] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46f17c96-2a3a-415a-8b88-fe6fa64e3db5 in Status: SUCCESS [ 949.820153] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.018704] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4580d502-1d18-4681-96a4-28ac4e291d69',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.177536] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.177789] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.177921] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.178464] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.178464] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.178566] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 4e8c0e78-8f1e-41c0-98cb-a6c5b0387b1b not found, creating... [ 950.178813] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.179020] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.179138] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.179339] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.179553] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.179790] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.179965] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.180917] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.181204] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.181357] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.181504] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 4e8c0e78-8f1e-41c0-98cb-a6c5b0387b1b is going to be created. [ 950.202949] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.203239] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.203372] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.203645] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.203990] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.204125] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-4e8c0e78-8f1e-41c0-98cb-a6c5b0387b1b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.520917] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.521024] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.521106] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.521322] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.521413] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.521518] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4580d502-1d18-4681-96a4-28ac4e291d69 is going to be updated. [ 950.552868] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.553075] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.553120] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.553305] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.553450] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.562495] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4580d502-1d18-4681-96a4-28ac4e291d69 in Status: IN_PROGRESS for 2s [ 951.191757] env[70764]: INFO networking_nsxv3.common.synchronization [req-38c832d4-ebc8-4d59-b503-2eaca751961a req-dffd8d35-b4dd-4143-88bb-6d94eda89fed service nova] Enqueued Resource ID: 4580d502-1d18-4681-96a4-28ac4e291d69 with Priority: HIGHEST for action security_group_rules [ 951.191757] env[70764]: INFO networking_nsxv3.common.synchronization [req-38c832d4-ebc8-4d59-b503-2eaca751961a req-dffd8d35-b4dd-4143-88bb-6d94eda89fed service nova] Enqueued Resource ID: 4580d502-1d18-4681-96a4-28ac4e291d69 with Priority: HIGHEST for action security_group_members [ 951.191757] env[70764]: INFO networking_nsxv3.common.synchronization [req-38c832d4-ebc8-4d59-b503-2eaca751961a req-dffd8d35-b4dd-4143-88bb-6d94eda89fed service nova] Enqueued Resource ID: 4e8c0e78-8f1e-41c0-98cb-a6c5b0387b1b with Priority: HIGHEST for action port [ 951.191757] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4580d502-1d18-4681-96a4-28ac4e291d69 with Priority: HIGHEST for action security_group_rules [ 951.191757] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4580d502-1d18-4681-96a4-28ac4e291d69 with Priority: HIGHEST for action security_group_members [ 951.191757] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e8c0e78-8f1e-41c0-98cb-a6c5b0387b1b with Priority: HIGHEST for action port [ 951.196022] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4580d502-1d18-4681-96a4-28ac4e291d69 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.196022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.196022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.196022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.196022] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4580d502-1d18-4681-96a4-28ac4e291d69',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.196022] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4580d502-1d18-4681-96a4-28ac4e291d69 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.196022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.196022] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e8c0e78-8f1e-41c0-98cb-a6c5b0387b1b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.196022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e8c0e78-8f1e-41c0-98cb-a6c5b0387b1b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.196022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e8c0e78-8f1e-41c0-98cb-a6c5b0387b1b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.196022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e8c0e78-8f1e-41c0-98cb-a6c5b0387b1b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.196022] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e8c0e78-8f1e-41c0-98cb-a6c5b0387b1b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.522304] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: SUCCESS [ 951.522713] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.522928] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.523205] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.523428] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.523584] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.523668] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.523880] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.523976] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.524106] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.524240] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.696880] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4580d502-1d18-4681-96a4-28ac4e291d69 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.697391] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.703661] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4e8c0e78-8f1e-41c0-98cb-a6c5b0387b1b with status ACTIVE [ 951.703661] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.703661] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.703661] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.703661] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.703661] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.703661] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.703661] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.703661] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.703661] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.703661] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.703661] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.703661] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.703661] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.703661] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.703661] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.703661] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4e8c0e78-8f1e-41c0-98cb-a6c5b0387b1b is going to be updated. [ 951.724074] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.724074] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.724074] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.724253] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.724311] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.724474] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e8c0e78-8f1e-41c0-98cb-a6c5b0387b1b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.027342] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.029585] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.029585] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.029585] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.029585] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.029585] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.029585] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.029585] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.029585] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.029585] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.029585] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.029585] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.029585] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.029585] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.029585] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.029585] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.029585] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.029585] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.029585] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.030569] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.030569] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.533272] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f8f5efec-a14e-4be6-8add-7b35a995c982: rpc.has_security_group_logging(os_id): False [ 952.553620] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.557100] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.557100] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.557283] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.557380] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.557698] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.557804] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.557804] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.557943] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.558205] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.558268] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.558342] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.558389] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.558535] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.558630] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.558797] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.558981] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.558981] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.560712] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.560712] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.560712] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8f5efec-a14e-4be6-8add-7b35a995c982 is going to be updated. [ 952.572499] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4580d502-1d18-4681-96a4-28ac4e291d69 in Status: SUCCESS [ 952.572730] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.572928] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.573162] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.573363] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.573488] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.573552] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.573710] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.573883] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.573883] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4580d502-1d18-4681-96a4-28ac4e291d69',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.617303] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.618121] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.618366] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.618703] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.619158] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.637644] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: IN_PROGRESS for 2s [ 953.076260] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4580d502-1d18-4681-96a4-28ac4e291d69',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.579203] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4580d502-1d18-4681-96a4-28ac4e291d69',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.085022] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.085022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.085022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.085022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.085022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.085022] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4580d502-1d18-4681-96a4-28ac4e291d69 is going to be updated. [ 954.114689] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.115450] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.115593] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.115950] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.116150] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.124808] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4580d502-1d18-4681-96a4-28ac4e291d69 in Status: IN_PROGRESS for 2s [ 954.650834] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: SUCCESS [ 954.651290] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.572347] env[70764]: INFO networking_nsxv3.common.synchronization [None req-568519bb-bfd7-4e08-a44e-8a5d72c4a999 None None] Enqueued Resource ID: e49c275a-1724-4885-829e-5159d414d25d with Priority: HIGHEST for action port [ 955.572876] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e49c275a-1724-4885-829e-5159d414d25d with Priority: HIGHEST for action port [ 955.573192] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-e49c275a-1724-4885-829e-5159d414d25d taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.573312] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e49c275a-1724-4885-829e-5159d414d25d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.573375] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e49c275a-1724-4885-829e-5159d414d25d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.573628] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e49c275a-1724-4885-829e-5159d414d25d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.573709] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e49c275a-1724-4885-829e-5159d414d25d',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.075923] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e49c275a-1724-4885-829e-5159d414d25d [ 956.078017] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.078017] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.078017] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.078017] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.078017] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.078017] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e49c275a-1724-4885-829e-5159d414d25d already deleted. [ 956.078017] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e49c275a-1724-4885-829e-5159d414d25d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.138825] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4580d502-1d18-4681-96a4-28ac4e291d69 in Status: IN_PROGRESS for 4s [ 956.210915] env[70764]: INFO networking_nsxv3.common.synchronization [None req-947155c5-be6f-4965-85c0-6b3f0f7a1661 tempest-ServerActionsTestOtherB-1188510512 tempest-ServerActionsTestOtherB-1188510512-project-member] Enqueued Resource ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b with Priority: HIGHEST for action security_group_rules [ 956.212526] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b with Priority: HIGHEST for action security_group_rules [ 956.212933] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.213087] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.213153] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.213521] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.213624] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.467644] env[70764]: INFO networking_nsxv3.common.synchronization [None req-b9dad61e-e7cc-4924-b6b6-7c8061c985d7 tempest-ServerActionsTestOtherB-1188510512 tempest-ServerActionsTestOtherB-1188510512-project-member] Enqueued Resource ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b with Priority: HIGHEST for action security_group_rules [ 956.468873] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b with Priority: HIGHEST for action security_group_rules [ 956.468873] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.468873] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.742309] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.742309] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.742309] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.742464] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.742551] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.742651] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b already deleted. [ 956.742732] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.742911] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.743081] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.743265] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.266656] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.267025] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.267025] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.267154] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.267256] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.267359] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b already deleted. [ 957.267443] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.357470] env[70764]: INFO networking_nsxv3.common.synchronization [None req-65bb7bd1-2988-40f0-834f-3b35b22eac03 tempest-AttachVolumeNegativeTest-232785497 tempest-AttachVolumeNegativeTest-232785497-project-member] Enqueued Resource ID: b9410f01-20de-42de-8117-bdf11cf59643 with Priority: HIGHEST for action security_group_rules [ 957.357470] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9410f01-20de-42de-8117-bdf11cf59643 with Priority: HIGHEST for action security_group_rules [ 957.357892] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b9410f01-20de-42de-8117-bdf11cf59643 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.358039] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b9410f01-20de-42de-8117-bdf11cf59643" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.358111] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b9410f01-20de-42de-8117-bdf11cf59643" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.358371] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b9410f01-20de-42de-8117-bdf11cf59643" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.358459] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b9410f01-20de-42de-8117-bdf11cf59643',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.489019] env[70764]: INFO networking_nsxv3.common.synchronization [None req-566fe3f4-9b23-426e-b4b6-c869c78a88f6 tempest-AttachVolumeNegativeTest-232785497 tempest-AttachVolumeNegativeTest-232785497-project-member] Enqueued Resource ID: b9410f01-20de-42de-8117-bdf11cf59643 with Priority: HIGHEST for action security_group_rules [ 957.489019] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9410f01-20de-42de-8117-bdf11cf59643 with Priority: HIGHEST for action security_group_rules [ 957.489019] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b9410f01-20de-42de-8117-bdf11cf59643 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.489019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b9410f01-20de-42de-8117-bdf11cf59643" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.884697] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.884958] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.885100] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.885380] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.885852] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.886012] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b9410f01-20de-42de-8117-bdf11cf59643 already deleted. [ 957.886229] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b9410f01-20de-42de-8117-bdf11cf59643" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.886481] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b9410f01-20de-42de-8117-bdf11cf59643" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.886766] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b9410f01-20de-42de-8117-bdf11cf59643" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.887432] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b9410f01-20de-42de-8117-bdf11cf59643',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.152298] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4580d502-1d18-4681-96a4-28ac4e291d69 in Status: SUCCESS [ 958.152298] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.152298] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.152298] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.152522] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.152773] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.152773] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.153768] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.153856] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.153900] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.153997] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4580d502-1d18-4681-96a4-28ac4e291d69',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.260765] env[70764]: INFO networking_nsxv3.common.synchronization [None req-8b066d35-169b-41e7-b41b-6f1f768e749f None None] Enqueued Resource ID: 08b9a745-c08a-451f-8f5d-2056604db20c with Priority: HIGHEST for action port [ 958.262019] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08b9a745-c08a-451f-8f5d-2056604db20c with Priority: HIGHEST for action port [ 958.262019] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-08b9a745-c08a-451f-8f5d-2056604db20c taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.262019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08b9a745-c08a-451f-8f5d-2056604db20c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.262019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08b9a745-c08a-451f-8f5d-2056604db20c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.262517] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08b9a745-c08a-451f-8f5d-2056604db20c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.262517] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08b9a745-c08a-451f-8f5d-2056604db20c',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.408105] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.408512] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.408512] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.408763] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.408763] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.408763] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b9410f01-20de-42de-8117-bdf11cf59643 already deleted. [ 958.408763] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b9410f01-20de-42de-8117-bdf11cf59643" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.658100] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4580d502-1d18-4681-96a4-28ac4e291d69 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.658100] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.658337] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.658609] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.658609] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.658772] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.658772] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.658933] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.659035] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.659130] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.659317] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4580d502-1d18-4681-96a4-28ac4e291d69 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.659378] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.659445] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.659583] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.659781] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.659918] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.659982] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.660169] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.660233] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.660275] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.660405] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4580d502-1d18-4681-96a4-28ac4e291d69',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.764546] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 08b9a745-c08a-451f-8f5d-2056604db20c [ 958.764895] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.765081] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.765166] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.765458] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.765584] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.765698] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:08b9a745-c08a-451f-8f5d-2056604db20c already deleted. [ 958.765809] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08b9a745-c08a-451f-8f5d-2056604db20c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.163807] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4580d502-1d18-4681-96a4-28ac4e291d69: rpc.has_security_group_logging(os_id): False [ 959.187407] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.187547] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.187645] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.187880] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.187976] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.188219] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.188329] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.188398] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.188620] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.188620] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.188804] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.188900] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.188962] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.189120] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.189193] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.189374] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.189468] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.189522] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.189842] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.189842] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.189842] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4580d502-1d18-4681-96a4-28ac4e291d69 is going to be updated. [ 959.254153] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.254153] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.254153] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.254153] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.254570] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.273753] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4580d502-1d18-4681-96a4-28ac4e291d69 in Status: IN_PROGRESS for 2s [ 959.623380] env[70764]: INFO networking_nsxv3.common.synchronization [req-9286e00e-7fb4-4152-830f-c737ef63ea8c req-54172719-fb67-4626-9c84-a4ce515bb574 tempest-ServersTestJSON-88830314 tempest-ServersTestJSON-88830314-project-member] Enqueued Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_members [ 959.624190] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_members [ 959.624344] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.624479] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.624564] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.624733] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.624885] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.624981] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.625055] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.625196] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.625305] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.625398] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.127591] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.419684] env[70764]: INFO networking_nsxv3.common.synchronization [None req-b981d1b2-c483-4dfb-bce4-ade6e8dfe622 None None] Enqueued Resource ID: 30411ffb-0844-4bd4-a800-daa52ae798c3 with Priority: HIGHEST for action port [ 960.421031] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30411ffb-0844-4bd4-a800-daa52ae798c3 with Priority: HIGHEST for action port [ 960.421031] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-30411ffb-0844-4bd4-a800-daa52ae798c3 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.421031] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30411ffb-0844-4bd4-a800-daa52ae798c3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.421031] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30411ffb-0844-4bd4-a800-daa52ae798c3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.421031] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30411ffb-0844-4bd4-a800-daa52ae798c3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.421362] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30411ffb-0844-4bd4-a800-daa52ae798c3',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.634414] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.923428] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 30411ffb-0844-4bd4-a800-daa52ae798c3 [ 960.923428] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.923428] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.923428] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.923759] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.923759] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.923824] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:30411ffb-0844-4bd4-a800-daa52ae798c3 already deleted. [ 960.923858] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30411ffb-0844-4bd4-a800-daa52ae798c3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.136923] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.138405] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.138567] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.138817] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.138918] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.139034] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8f5efec-a14e-4be6-8add-7b35a995c982 is going to be updated. [ 961.167990] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.168164] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.168231] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.168488] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.168632] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.177334] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: IN_PROGRESS for 2s [ 961.287569] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4580d502-1d18-4681-96a4-28ac4e291d69 in Status: SUCCESS [ 961.287569] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.693267] env[70764]: INFO networking_nsxv3.common.synchronization [None req-d812d39b-938b-49bd-af9a-d2aef375f40b None None] Enqueued Resource ID: fb418fb7-3a21-456a-ad55-8154d8eb7561 with Priority: HIGHEST for action port [ 962.693578] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb418fb7-3a21-456a-ad55-8154d8eb7561 with Priority: HIGHEST for action port [ 962.695354] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb418fb7-3a21-456a-ad55-8154d8eb7561 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.695354] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb418fb7-3a21-456a-ad55-8154d8eb7561" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.695354] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb418fb7-3a21-456a-ad55-8154d8eb7561" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.695354] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb418fb7-3a21-456a-ad55-8154d8eb7561" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.695354] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb418fb7-3a21-456a-ad55-8154d8eb7561',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.190783] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: SUCCESS [ 963.191119] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.196664] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fb418fb7-3a21-456a-ad55-8154d8eb7561 [ 963.196904] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.197062] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.197130] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.197335] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.197416] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.197510] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fb418fb7-3a21-456a-ad55-8154d8eb7561 already deleted. [ 963.197589] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb418fb7-3a21-456a-ad55-8154d8eb7561" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.413588] env[70764]: INFO networking_nsxv3.common.synchronization [None req-34a991b0-1126-46ce-896e-1b2e7bfa831f None None] Enqueued Resource ID: cb854655-ab0d-4136-a532-e06b20c499d8 with Priority: HIGHEST for action port [ 964.413866] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb854655-ab0d-4136-a532-e06b20c499d8 with Priority: HIGHEST for action port [ 964.415516] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb854655-ab0d-4136-a532-e06b20c499d8 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.415516] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb854655-ab0d-4136-a532-e06b20c499d8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.415516] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb854655-ab0d-4136-a532-e06b20c499d8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.415721] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb854655-ab0d-4136-a532-e06b20c499d8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.415721] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb854655-ab0d-4136-a532-e06b20c499d8',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.923129] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cb854655-ab0d-4136-a532-e06b20c499d8 [ 964.923129] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.923129] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.923129] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.923129] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.923129] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.923129] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cb854655-ab0d-4136-a532-e06b20c499d8 already deleted. [ 964.923129] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb854655-ab0d-4136-a532-e06b20c499d8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.503916] env[70764]: INFO networking_nsxv3.common.synchronization [req-da228972-d312-4789-93fe-467864c932f3 req-6b00511d-e525-4a71-96db-72c0aee70804 tempest-InstanceActionsNegativeTestJSON-652653537 tempest-InstanceActionsNegativeTestJSON-652653537-project-member] Enqueued Resource ID: 5ec7f171-db73-4bef-97dc-92782231e84b with Priority: HIGHEST for action security_group_members [ 965.508021] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ec7f171-db73-4bef-97dc-92782231e84b with Priority: HIGHEST for action security_group_members [ 965.508021] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ec7f171-db73-4bef-97dc-92782231e84b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.508021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ec7f171-db73-4bef-97dc-92782231e84b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.508021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ec7f171-db73-4bef-97dc-92782231e84b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.508021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ec7f171-db73-4bef-97dc-92782231e84b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.508021] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.508758] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.508820] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.509511] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.509612] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.509743] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ec7f171-db73-4bef-97dc-92782231e84b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.012688] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.013551] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.013829] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.014181] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.014395] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.015345] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.015345] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.015345] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.015345] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.015345] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.015345] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ec7f171-db73-4bef-97dc-92782231e84b already deleted. [ 966.015345] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ec7f171-db73-4bef-97dc-92782231e84b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.289292] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-842 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.289812] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-842" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.289812] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-842" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.290850] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-842" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.291327] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.291464] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.291695] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.291967] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.292192] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.293743] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 966.293743] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 966.293743] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 966.293743] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 966.293743] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 966.293743] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 966.293743] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 966.315652] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 966.316238] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 966.316238] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 966.316238] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-842" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.316449] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-6445eb9f-89d1-47c7-a32f-8b1a4197c539 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.316906] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-6445eb9f-89d1-47c7-a32f-8b1a4197c539" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.316906] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-6445eb9f-89d1-47c7-a32f-8b1a4197c539" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.316906] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-6445eb9f-89d1-47c7-a32f-8b1a4197c539" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.317113] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6445eb9f-89d1-47c7-a32f-8b1a4197c539',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.764035] env[70764]: INFO networking_nsxv3.common.synchronization [req-02165db0-5270-46b4-81df-0441c81d7826 req-c4d299c9-9759-4caa-adda-5d1a8bce1c71 tempest-ServerDiskConfigTestJSON-1914051978 tempest-ServerDiskConfigTestJSON-1914051978-project-member] Enqueued Resource ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 with Priority: HIGHEST for action security_group_members [ 966.764035] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 with Priority: HIGHEST for action security_group_members [ 966.764035] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-56646d46-eb79-4ebc-a596-a5a17716f8e4 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.764035] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.768371] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.768371] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.768371] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.768371] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.768371] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.768371] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.768371] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.768371] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56646d46-eb79-4ebc-a596-a5a17716f8e4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.819478] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.819724] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.819879] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.820195] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.820347] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.820504] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 6445eb9f-89d1-47c7-a32f-8b1a4197c539 not found, creating... [ 966.820769] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.820930] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.821128] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.821284] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.821423] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.821707] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.821873] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.822313] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.822581] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.822759] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.822939] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 6445eb9f-89d1-47c7-a32f-8b1a4197c539 is going to be created. [ 966.856179] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.856483] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.856655] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.856957] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.857238] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.857469] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-6445eb9f-89d1-47c7-a32f-8b1a4197c539" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.043037] env[70764]: INFO networking_nsxv3.common.synchronization [None req-bd9bd998-30e7-4b42-ae31-1f3331043670 None None] Enqueued Resource ID: 08763b79-dfdc-4959-9200-76ea8e7c1c9c with Priority: HIGHEST for action port [ 967.043037] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08763b79-dfdc-4959-9200-76ea8e7c1c9c with Priority: HIGHEST for action port [ 967.043037] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-08763b79-dfdc-4959-9200-76ea8e7c1c9c taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.043037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08763b79-dfdc-4959-9200-76ea8e7c1c9c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.043037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08763b79-dfdc-4959-9200-76ea8e7c1c9c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.043037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08763b79-dfdc-4959-9200-76ea8e7c1c9c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.043037] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08763b79-dfdc-4959-9200-76ea8e7c1c9c',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.271987] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.271987] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.271987] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.271987] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.271987] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.275572] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.275572] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.275572] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.275572] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.275572] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.275572] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 is going to be updated. [ 967.299649] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.299811] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.300666] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.300666] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.300666] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.310238] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 in Status: IN_PROGRESS for 2s [ 967.544883] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 08763b79-dfdc-4959-9200-76ea8e7c1c9c [ 967.544991] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.545199] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.545302] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.545867] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.546081] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.546144] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:08763b79-dfdc-4959-9200-76ea8e7c1c9c already deleted. [ 967.546192] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08763b79-dfdc-4959-9200-76ea8e7c1c9c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.706420] env[70764]: INFO networking_nsxv3.common.synchronization [req-da228972-d312-4789-93fe-467864c932f3 req-2b2f6b5d-4259-479f-9ed4-37d468997d58 service nova] Enqueued Resource ID: 5ec7f171-db73-4bef-97dc-92782231e84b with Priority: HIGHEST for action security_group_rules [ 967.706957] env[70764]: INFO networking_nsxv3.common.synchronization [req-da228972-d312-4789-93fe-467864c932f3 req-2b2f6b5d-4259-479f-9ed4-37d468997d58 service nova] Enqueued Resource ID: 5ec7f171-db73-4bef-97dc-92782231e84b with Priority: HIGHEST for action security_group_members [ 967.706957] env[70764]: INFO networking_nsxv3.common.synchronization [req-da228972-d312-4789-93fe-467864c932f3 req-2b2f6b5d-4259-479f-9ed4-37d468997d58 service nova] Enqueued Resource ID: 6445eb9f-89d1-47c7-a32f-8b1a4197c539 with Priority: HIGHEST for action port [ 967.708040] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ec7f171-db73-4bef-97dc-92782231e84b with Priority: HIGHEST for action security_group_rules [ 967.708040] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ec7f171-db73-4bef-97dc-92782231e84b with Priority: HIGHEST for action security_group_members [ 967.708040] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6445eb9f-89d1-47c7-a32f-8b1a4197c539 with Priority: HIGHEST for action port [ 967.708040] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5ec7f171-db73-4bef-97dc-92782231e84b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.708259] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5ec7f171-db73-4bef-97dc-92782231e84b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.708259] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5ec7f171-db73-4bef-97dc-92782231e84b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.708684] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5ec7f171-db73-4bef-97dc-92782231e84b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.708684] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5ec7f171-db73-4bef-97dc-92782231e84b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.709889] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ec7f171-db73-4bef-97dc-92782231e84b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.710023] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ec7f171-db73-4bef-97dc-92782231e84b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.710085] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ec7f171-db73-4bef-97dc-92782231e84b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.710281] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ec7f171-db73-4bef-97dc-92782231e84b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.710432] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.710572] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.710606] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.713181] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.713274] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.713378] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ec7f171-db73-4bef-97dc-92782231e84b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.714617] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-6445eb9f-89d1-47c7-a32f-8b1a4197c539 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.714728] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6445eb9f-89d1-47c7-a32f-8b1a4197c539" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.714795] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6445eb9f-89d1-47c7-a32f-8b1a4197c539" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.714970] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6445eb9f-89d1-47c7-a32f-8b1a4197c539" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.715070] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6445eb9f-89d1-47c7-a32f-8b1a4197c539',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.103437] env[70764]: INFO networking_nsxv3.common.synchronization [None req-a40bc71d-e9f8-4279-a694-cc319932fa8d None None] Enqueued Resource ID: 77d19c8b-d98b-43ce-9076-8b2aa934b2f2 with Priority: HIGHEST for action port [ 968.103701] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77d19c8b-d98b-43ce-9076-8b2aa934b2f2 with Priority: HIGHEST for action port [ 968.104973] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-77d19c8b-d98b-43ce-9076-8b2aa934b2f2 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.104973] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77d19c8b-d98b-43ce-9076-8b2aa934b2f2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.104973] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77d19c8b-d98b-43ce-9076-8b2aa934b2f2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.105152] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77d19c8b-d98b-43ce-9076-8b2aa934b2f2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.105474] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77d19c8b-d98b-43ce-9076-8b2aa934b2f2',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.211230] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ec7f171-db73-4bef-97dc-92782231e84b taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.211230] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ec7f171-db73-4bef-97dc-92782231e84b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.215675] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5ec7f171-db73-4bef-97dc-92782231e84b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.217691] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6445eb9f-89d1-47c7-a32f-8b1a4197c539 with status ACTIVE [ 968.217847] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.218028] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.219026] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.219026] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.219026] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.219026] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.219026] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.219026] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.219026] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.219522] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.219522] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.219522] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.219522] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.219640] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.219640] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.223020] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6445eb9f-89d1-47c7-a32f-8b1a4197c539 is going to be updated. [ 968.245235] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.245235] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.245235] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.245235] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.245235] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.245235] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6445eb9f-89d1-47c7-a32f-8b1a4197c539" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.608609] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 77d19c8b-d98b-43ce-9076-8b2aa934b2f2 [ 968.608609] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.608833] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.608946] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.609273] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.609481] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.609655] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:77d19c8b-d98b-43ce-9076-8b2aa934b2f2 already deleted. [ 968.609831] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77d19c8b-d98b-43ce-9076-8b2aa934b2f2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.718559] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5ec7f171-db73-4bef-97dc-92782231e84b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.222815] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.222815] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.222815] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.223286] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.223286] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.223286] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ec7f171-db73-4bef-97dc-92782231e84b is going to be created. [ 969.259719] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.259890] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.259965] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.260198] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.260354] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.269803] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ec7f171-db73-4bef-97dc-92782231e84b in Status: UNINITIALIZED for 2s [ 969.318680] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 in Status: SUCCESS [ 969.318871] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 deletion is rescheduled due to dependency. [ 969.318988] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.192924] env[70764]: INFO networking_nsxv3.common.synchronization [req-b6d6ad21-b814-482a-b578-e1de97325636 req-da3dec74-40cb-434d-a5eb-92fdc4d1e8ac tempest-ImagesTestJSON-1647743380 tempest-ImagesTestJSON-1647743380-project-member] Enqueued Resource ID: 4580d502-1d18-4681-96a4-28ac4e291d69 with Priority: HIGHEST for action security_group_members [ 970.193558] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4580d502-1d18-4681-96a4-28ac4e291d69 with Priority: HIGHEST for action security_group_members [ 970.193870] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4580d502-1d18-4681-96a4-28ac4e291d69 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.194017] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.199839] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.199839] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.199839] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.199839] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.199839] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.199839] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.199839] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.199839] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4580d502-1d18-4681-96a4-28ac4e291d69',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.228556] env[70764]: INFO networking_nsxv3.common.synchronization [None req-d4e46285-21d1-4fce-832f-36160e8c4b97 None None] Enqueued Resource ID: e7d336af-fbe1-4e74-be6a-769847b9d7ea with Priority: HIGHEST for action port [ 970.229581] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7d336af-fbe1-4e74-be6a-769847b9d7ea with Priority: HIGHEST for action port [ 970.231693] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7d336af-fbe1-4e74-be6a-769847b9d7ea taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.231809] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7d336af-fbe1-4e74-be6a-769847b9d7ea" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.231809] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7d336af-fbe1-4e74-be6a-769847b9d7ea" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.232530] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7d336af-fbe1-4e74-be6a-769847b9d7ea" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.232530] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7d336af-fbe1-4e74-be6a-769847b9d7ea',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.702516] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4580d502-1d18-4681-96a4-28ac4e291d69',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.735538] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e7d336af-fbe1-4e74-be6a-769847b9d7ea [ 970.735774] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.738021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.738021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.738021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.738021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.738021] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e7d336af-fbe1-4e74-be6a-769847b9d7ea already deleted. [ 970.738021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7d336af-fbe1-4e74-be6a-769847b9d7ea" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.771359] env[70764]: INFO networking_nsxv3.common.synchronization [req-07806242-395c-4422-b57c-151d1a957dc7 req-4930159e-18cc-4190-bce1-86f833d75bc1 tempest-MigrationsAdminTest-1035321564 tempest-MigrationsAdminTest-1035321564-project-member] Enqueued Resource ID: 46f17c96-2a3a-415a-8b88-fe6fa64e3db5 with Priority: HIGHEST for action security_group_members [ 970.772553] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46f17c96-2a3a-415a-8b88-fe6fa64e3db5 with Priority: HIGHEST for action security_group_members [ 970.772553] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.772553] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.772553] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.773375] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.773375] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.773375] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.773375] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.773537] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.777016] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.777016] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46f17c96-2a3a-415a-8b88-fe6fa64e3db5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.865140] env[70764]: INFO networking_nsxv3.common.synchronization [req-41884fce-0c7e-4d5d-b637-da142a1f993b req-dd122a23-dabb-40e6-939e-8b081960715c tempest-ServerPasswordTestJSON-2135639814 tempest-ServerPasswordTestJSON-2135639814-project-member] Enqueued Resource ID: 37e71aae-75a3-4784-89f9-86f606e096a1 with Priority: HIGHEST for action security_group_members [ 970.865382] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37e71aae-75a3-4784-89f9-86f606e096a1 with Priority: HIGHEST for action security_group_members [ 970.865711] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-37e71aae-75a3-4784-89f9-86f606e096a1 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.865830] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37e71aae-75a3-4784-89f9-86f606e096a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.865893] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37e71aae-75a3-4784-89f9-86f606e096a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.866205] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37e71aae-75a3-4784-89f9-86f606e096a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.866356] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.866453] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.866513] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.866659] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.866742] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.866834] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37e71aae-75a3-4784-89f9-86f606e096a1',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.206434] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4580d502-1d18-4681-96a4-28ac4e291d69',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.277596] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.277853] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.277853] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.278107] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.278205] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.278413] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.278518] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.278582] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.278744] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.278825] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.278908] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46f17c96-2a3a-415a-8b88-fe6fa64e3db5 is going to be updated. [ 971.303069] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ec7f171-db73-4bef-97dc-92782231e84b in Status: SUCCESS [ 971.303303] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ec7f171-db73-4bef-97dc-92782231e84b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.303472] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ec7f171-db73-4bef-97dc-92782231e84b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.303725] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ec7f171-db73-4bef-97dc-92782231e84b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.303913] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.304047] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.304092] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.304319] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.304319] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.304545] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ec7f171-db73-4bef-97dc-92782231e84b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.304545] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5ec7f171-db73-4bef-97dc-92782231e84b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.311649] env[70764]: INFO networking_nsxv3.common.synchronization [req-63b1e42f-aa8f-4b6b-bbc0-6d2738d07c00 req-39965b35-4261-4be3-b0eb-04b73e1b85de tempest-AttachVolumeTestJSON-503324066 tempest-AttachVolumeTestJSON-503324066-project-member] Enqueued Resource ID: 6e903658-277d-417d-95d4-4fcc19078cba with Priority: HIGHEST for action security_group_members [ 971.312353] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e903658-277d-417d-95d4-4fcc19078cba with Priority: HIGHEST for action security_group_members [ 971.312655] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e903658-277d-417d-95d4-4fcc19078cba taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.312777] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e903658-277d-417d-95d4-4fcc19078cba" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.312847] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e903658-277d-417d-95d4-4fcc19078cba" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.313039] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e903658-277d-417d-95d4-4fcc19078cba" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.313193] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.313296] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.313360] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.313502] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.313582] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.313673] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e903658-277d-417d-95d4-4fcc19078cba',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.323379] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.323507] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.323584] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.323775] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.323906] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.337168] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46f17c96-2a3a-415a-8b88-fe6fa64e3db5 in Status: IN_PROGRESS for 2s [ 971.368804] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.368978] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.369037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.369258] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.369346] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.369547] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.369646] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.369707] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.369988] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.370084] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.370171] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37e71aae-75a3-4784-89f9-86f606e096a1 already deleted. [ 971.370250] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37e71aae-75a3-4784-89f9-86f606e096a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.584691] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-762 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.585093] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-762" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.585669] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-762" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.585975] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-762" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.586549] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.586835] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.587102] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.587612] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.587796] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.588156] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 971.588386] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 971.588604] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 971.588815] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 971.589166] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 971.589410] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 971.589671] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 971.608884] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 971.608884] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 971.609024] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 971.609277] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-762" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.609813] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-4eb01b87-7023-4373-8261-e9d2956711ea taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.610074] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-4eb01b87-7023-4373-8261-e9d2956711ea" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.610313] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-4eb01b87-7023-4373-8261-e9d2956711ea" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.610852] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-4eb01b87-7023-4373-8261-e9d2956711ea" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.610991] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4eb01b87-7023-4373-8261-e9d2956711ea',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.708936] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.709240] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.709353] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.709617] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.709737] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.709958] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4580d502-1d18-4681-96a4-28ac4e291d69 is going to be updated. [ 971.738979] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.739412] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.739589] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.739862] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.740114] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.749404] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4580d502-1d18-4681-96a4-28ac4e291d69 in Status: IN_PROGRESS for 2s [ 971.815872] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ec7f171-db73-4bef-97dc-92782231e84b taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.816151] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ec7f171-db73-4bef-97dc-92782231e84b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.816279] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ec7f171-db73-4bef-97dc-92782231e84b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.816549] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ec7f171-db73-4bef-97dc-92782231e84b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.816783] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.816935] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.817054] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.817280] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.818735] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.819381] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ec7f171-db73-4bef-97dc-92782231e84b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.819634] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ec7f171-db73-4bef-97dc-92782231e84b taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.820727] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ec7f171-db73-4bef-97dc-92782231e84b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.820853] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ec7f171-db73-4bef-97dc-92782231e84b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.821087] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ec7f171-db73-4bef-97dc-92782231e84b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.821649] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.822230] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.822356] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.823594] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.823594] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.823594] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ec7f171-db73-4bef-97dc-92782231e84b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.823594] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5ec7f171-db73-4bef-97dc-92782231e84b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.825277] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.826428] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.826428] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.826978] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.850053] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.850476] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.850698] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.851142] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.851142] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.851251] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.851378] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e903658-277d-417d-95d4-4fcc19078cba is going to be updated. [ 971.878036] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.878498] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.878498] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.878681] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.878681] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.886766] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e903658-277d-417d-95d4-4fcc19078cba in Status: IN_PROGRESS for 2s [ 972.113762] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.114097] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.114097] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.114400] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.114589] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.114749] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 4eb01b87-7023-4373-8261-e9d2956711ea not found, creating... [ 972.115029] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.115200] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.115321] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.115560] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.115705] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.116514] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.116730] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.116860] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.117272] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.117463] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.117643] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 4eb01b87-7023-4373-8261-e9d2956711ea is going to be created. [ 972.141052] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.141052] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.141052] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.141253] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.141355] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.141595] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-4eb01b87-7023-4373-8261-e9d2956711ea" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.330780] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5ec7f171-db73-4bef-97dc-92782231e84b: rpc.has_security_group_logging(os_id): False [ 972.354506] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.354506] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.354506] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.354506] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.354506] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.354707] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.354707] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.354707] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.354849] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.354925] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.355123] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.355218] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.355316] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.355417] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.355483] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.355660] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.355815] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.355815] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.355940] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.356052] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.356158] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5ec7f171-db73-4bef-97dc-92782231e84b is going to be created. [ 972.419186] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.419385] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.419431] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.419664] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.419800] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.432352] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5ec7f171-db73-4bef-97dc-92782231e84b in Status: IN_PROGRESS for 2s [ 973.178625] env[70764]: INFO networking_nsxv3.common.synchronization [req-41884fce-0c7e-4d5d-b637-da142a1f993b req-c43abe62-2685-4d4a-9bb9-b96422cf2bbe service nova] Enqueued Resource ID: 37e71aae-75a3-4784-89f9-86f606e096a1 with Priority: HIGHEST for action security_group_rules [ 973.178812] env[70764]: INFO networking_nsxv3.common.synchronization [req-41884fce-0c7e-4d5d-b637-da142a1f993b req-c43abe62-2685-4d4a-9bb9-b96422cf2bbe service nova] Enqueued Resource ID: 37e71aae-75a3-4784-89f9-86f606e096a1 with Priority: HIGHEST for action security_group_members [ 973.178954] env[70764]: INFO networking_nsxv3.common.synchronization [req-41884fce-0c7e-4d5d-b637-da142a1f993b req-c43abe62-2685-4d4a-9bb9-b96422cf2bbe service nova] Enqueued Resource ID: 4eb01b87-7023-4373-8261-e9d2956711ea with Priority: HIGHEST for action port [ 973.179230] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37e71aae-75a3-4784-89f9-86f606e096a1 with Priority: HIGHEST for action security_group_rules [ 973.179363] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37e71aae-75a3-4784-89f9-86f606e096a1 with Priority: HIGHEST for action security_group_members [ 973.179458] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb01b87-7023-4373-8261-e9d2956711ea with Priority: HIGHEST for action port [ 973.180016] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37e71aae-75a3-4784-89f9-86f606e096a1 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.185264] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37e71aae-75a3-4784-89f9-86f606e096a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.185264] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37e71aae-75a3-4784-89f9-86f606e096a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.185264] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37e71aae-75a3-4784-89f9-86f606e096a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.185264] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37e71aae-75a3-4784-89f9-86f606e096a1',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.185264] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-37e71aae-75a3-4784-89f9-86f606e096a1 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.185264] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37e71aae-75a3-4784-89f9-86f606e096a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.185264] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37e71aae-75a3-4784-89f9-86f606e096a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.185264] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37e71aae-75a3-4784-89f9-86f606e096a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.185264] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.185264] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.185264] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.185264] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.185264] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.185264] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37e71aae-75a3-4784-89f9-86f606e096a1',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.186527] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-4eb01b87-7023-4373-8261-e9d2956711ea taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.187188] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4eb01b87-7023-4373-8261-e9d2956711ea" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.187758] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4eb01b87-7023-4373-8261-e9d2956711ea" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.189338] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4eb01b87-7023-4373-8261-e9d2956711ea" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.189338] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4eb01b87-7023-4373-8261-e9d2956711ea',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.349987] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46f17c96-2a3a-415a-8b88-fe6fa64e3db5 in Status: SUCCESS [ 973.350329] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46f17c96-2a3a-415a-8b88-fe6fa64e3db5 deletion is rescheduled due to dependency. [ 973.350329] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46f17c96-2a3a-415a-8b88-fe6fa64e3db5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.691076] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37e71aae-75a3-4784-89f9-86f606e096a1',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.692158] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-37e71aae-75a3-4784-89f9-86f606e096a1 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.692267] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37e71aae-75a3-4784-89f9-86f606e096a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.692436] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4eb01b87-7023-4373-8261-e9d2956711ea with status ACTIVE [ 973.692596] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.692702] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.692769] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.693051] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.693284] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.693350] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.693437] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.693490] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.693649] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.693726] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.693927] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.694388] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.694486] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.694640] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.694719] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.694895] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4eb01b87-7023-4373-8261-e9d2956711ea is going to be updated. [ 973.714838] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.714956] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.715043] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.715225] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.715350] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.715507] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4eb01b87-7023-4373-8261-e9d2956711ea" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.757600] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4580d502-1d18-4681-96a4-28ac4e291d69 in Status: SUCCESS [ 973.757710] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.898716] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e903658-277d-417d-95d4-4fcc19078cba in Status: SUCCESS [ 973.898965] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e903658-277d-417d-95d4-4fcc19078cba deletion is rescheduled due to dependency. [ 973.899039] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e903658-277d-417d-95d4-4fcc19078cba" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.116705] env[70764]: INFO networking_nsxv3.common.synchronization [None req-36db16d4-cca9-45ca-a938-2fbd0728e1cb None None] Enqueued Resource ID: 18e72b46-3d24-4aca-87b0-df4ec39dece7 with Priority: HIGHEST for action port [ 974.116974] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18e72b46-3d24-4aca-87b0-df4ec39dece7 with Priority: HIGHEST for action port [ 974.117554] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-18e72b46-3d24-4aca-87b0-df4ec39dece7 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.117683] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18e72b46-3d24-4aca-87b0-df4ec39dece7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.117753] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18e72b46-3d24-4aca-87b0-df4ec39dece7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.118008] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18e72b46-3d24-4aca-87b0-df4ec39dece7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.118317] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18e72b46-3d24-4aca-87b0-df4ec39dece7',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.196664] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37e71aae-75a3-4784-89f9-86f606e096a1',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.453935] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5ec7f171-db73-4bef-97dc-92782231e84b in Status: SUCCESS [ 974.453935] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5ec7f171-db73-4bef-97dc-92782231e84b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.620883] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 18e72b46-3d24-4aca-87b0-df4ec39dece7 [ 974.620883] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.620883] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.620883] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.620883] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.620883] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.620883] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:18e72b46-3d24-4aca-87b0-df4ec39dece7 already deleted. [ 974.620883] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18e72b46-3d24-4aca-87b0-df4ec39dece7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.698671] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.698842] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.698903] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.699179] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.699281] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.699386] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37e71aae-75a3-4784-89f9-86f606e096a1 is going to be created. [ 974.721605] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.721781] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.721833] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.722207] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.722388] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.731130] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37e71aae-75a3-4784-89f9-86f606e096a1 in Status: UNINITIALIZED for 2s [ 975.677426] env[70764]: INFO networking_nsxv3.common.synchronization [req-4da5a666-bd47-4f47-9974-1880c0f6ddb5 req-a63c0af4-28da-4a5c-bd96-e463bc4af781 tempest-ServerActionsTestOtherB-1188510512 tempest-ServerActionsTestOtherB-1188510512-project-member] Enqueued Resource ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b with Priority: HIGHEST for action security_group_members [ 975.677980] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b with Priority: HIGHEST for action security_group_members [ 975.678372] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.678502] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.678586] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.678811] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.678967] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.680503] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.680503] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.680503] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.680503] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.680503] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.183611] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-853 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.183611] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-853" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.183611] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-853" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.183611] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-853" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.184369] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.184539] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.184669] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.185099] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.185099] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.185288] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 976.185406] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 976.185723] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 976.185723] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 976.185839] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 976.185839] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 976.185972] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 976.187181] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.187263] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.187319] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.188022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.188022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.188022] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.188022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.188022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.188022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.188337] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.188337] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b already deleted. [ 976.188337] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.215325] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 976.215325] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 976.215495] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 976.215772] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-853" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.216285] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-ae2165fd-f83d-4e2c-9b0c-bc204ebfb5f2 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.216401] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-ae2165fd-f83d-4e2c-9b0c-bc204ebfb5f2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.216562] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-ae2165fd-f83d-4e2c-9b0c-bc204ebfb5f2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.216961] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-ae2165fd-f83d-4e2c-9b0c-bc204ebfb5f2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.217399] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae2165fd-f83d-4e2c-9b0c-bc204ebfb5f2',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.425110] env[70764]: INFO networking_nsxv3.common.synchronization [None req-4a8f7996-59b3-4e7a-8ccf-86370daf9cc9 None None] Enqueued Resource ID: fe177329-10a0-400b-85b0-cf7f6b107d6e with Priority: HIGHEST for action port [ 976.425110] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe177329-10a0-400b-85b0-cf7f6b107d6e with Priority: HIGHEST for action port [ 976.425110] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe177329-10a0-400b-85b0-cf7f6b107d6e taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.425110] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe177329-10a0-400b-85b0-cf7f6b107d6e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.425110] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe177329-10a0-400b-85b0-cf7f6b107d6e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.425110] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe177329-10a0-400b-85b0-cf7f6b107d6e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.425110] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe177329-10a0-400b-85b0-cf7f6b107d6e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.720052] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.720052] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.721258] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.721258] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.721258] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.721258] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port ae2165fd-f83d-4e2c-9b0c-bc204ebfb5f2 not found, creating... [ 976.721258] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.721258] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.721462] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.721599] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.721752] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.722193] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.722375] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.722514] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.722747] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.722903] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.723073] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: ae2165fd-f83d-4e2c-9b0c-bc204ebfb5f2 is going to be created. [ 976.738383] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37e71aae-75a3-4784-89f9-86f606e096a1 in Status: SUCCESS [ 976.738808] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37e71aae-75a3-4784-89f9-86f606e096a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.738808] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37e71aae-75a3-4784-89f9-86f606e096a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.738889] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37e71aae-75a3-4784-89f9-86f606e096a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.739081] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.739193] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.739255] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.739444] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.739544] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.739633] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37e71aae-75a3-4784-89f9-86f606e096a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.739723] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('37e71aae-75a3-4784-89f9-86f606e096a1',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.743238] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.743432] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.743552] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.744297] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.744297] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.744297] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-ae2165fd-f83d-4e2c-9b0c-bc204ebfb5f2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.927606] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fe177329-10a0-400b-85b0-cf7f6b107d6e [ 976.927743] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.927814] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.927884] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.928121] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.928228] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.928310] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fe177329-10a0-400b-85b0-cf7f6b107d6e already deleted. [ 976.928399] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe177329-10a0-400b-85b0-cf7f6b107d6e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.242299] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-37e71aae-75a3-4784-89f9-86f606e096a1 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.242444] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37e71aae-75a3-4784-89f9-86f606e096a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.242444] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37e71aae-75a3-4784-89f9-86f606e096a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.242615] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37e71aae-75a3-4784-89f9-86f606e096a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.242785] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.242883] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.242978] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.243143] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.243230] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.243318] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37e71aae-75a3-4784-89f9-86f606e096a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.243463] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-37e71aae-75a3-4784-89f9-86f606e096a1 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.243595] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37e71aae-75a3-4784-89f9-86f606e096a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.243595] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37e71aae-75a3-4784-89f9-86f606e096a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.243739] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37e71aae-75a3-4784-89f9-86f606e096a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.243873] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.243964] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.244049] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.244192] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.244270] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.244357] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37e71aae-75a3-4784-89f9-86f606e096a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.244441] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('37e71aae-75a3-4784-89f9-86f606e096a1',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.597272] env[70764]: INFO networking_nsxv3.common.synchronization [req-4da5a666-bd47-4f47-9974-1880c0f6ddb5 req-bb7cd030-27f6-4c57-a70f-ff764ec52b76 service nova] Enqueued Resource ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b with Priority: HIGHEST for action security_group_rules [ 977.597460] env[70764]: INFO networking_nsxv3.common.synchronization [req-4da5a666-bd47-4f47-9974-1880c0f6ddb5 req-bb7cd030-27f6-4c57-a70f-ff764ec52b76 service nova] Enqueued Resource ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b with Priority: HIGHEST for action security_group_members [ 977.597601] env[70764]: INFO networking_nsxv3.common.synchronization [req-4da5a666-bd47-4f47-9974-1880c0f6ddb5 req-bb7cd030-27f6-4c57-a70f-ff764ec52b76 service nova] Enqueued Resource ID: ae2165fd-f83d-4e2c-9b0c-bc204ebfb5f2 with Priority: HIGHEST for action port [ 977.597833] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b with Priority: HIGHEST for action security_group_rules [ 977.597961] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b with Priority: HIGHEST for action security_group_members [ 977.598119] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae2165fd-f83d-4e2c-9b0c-bc204ebfb5f2 with Priority: HIGHEST for action port [ 977.598625] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.598750] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.598818] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.599029] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.599116] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.600200] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.600200] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.600200] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.600401] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.600401] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.600481] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.603609] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.603609] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.603609] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.603609] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.603609] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae2165fd-f83d-4e2c-9b0c-bc204ebfb5f2 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.603609] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae2165fd-f83d-4e2c-9b0c-bc204ebfb5f2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.603609] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae2165fd-f83d-4e2c-9b0c-bc204ebfb5f2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.603609] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae2165fd-f83d-4e2c-9b0c-bc204ebfb5f2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.603609] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae2165fd-f83d-4e2c-9b0c-bc204ebfb5f2',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.747448] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 37e71aae-75a3-4784-89f9-86f606e096a1: rpc.has_security_group_logging(os_id): False [ 977.764512] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.764512] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.764512] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.764512] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.764831] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.764939] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.765090] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.765185] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.765374] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.765480] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.765710] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.766758] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.766758] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.766758] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.766758] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.766758] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.766758] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.766758] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.766758] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.766758] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.766758] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37e71aae-75a3-4784-89f9-86f606e096a1 is going to be created. [ 977.788442] env[70764]: INFO networking_nsxv3.common.synchronization [req-7b0ce03b-7a37-45e0-a1f4-b13a63e400f7 req-7936f6b4-044f-43ac-93f1-8aa7f5128378 tempest-AttachVolumeNegativeTest-232785497 tempest-AttachVolumeNegativeTest-232785497-project-member] Enqueued Resource ID: b9410f01-20de-42de-8117-bdf11cf59643 with Priority: HIGHEST for action security_group_members [ 977.789380] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9410f01-20de-42de-8117-bdf11cf59643 with Priority: HIGHEST for action security_group_members [ 977.789719] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9410f01-20de-42de-8117-bdf11cf59643 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.789858] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9410f01-20de-42de-8117-bdf11cf59643" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.789931] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9410f01-20de-42de-8117-bdf11cf59643" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.790571] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9410f01-20de-42de-8117-bdf11cf59643" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.790732] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.790845] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.790895] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.791065] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.791146] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.791244] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b9410f01-20de-42de-8117-bdf11cf59643',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.839246] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.839423] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.839488] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.839716] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.839822] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.857043] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37e71aae-75a3-4784-89f9-86f606e096a1 in Status: IN_PROGRESS for 2s [ 978.106838] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.106838] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.106838] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.106838] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ae2165fd-f83d-4e2c-9b0c-bc204ebfb5f2 with status ACTIVE [ 978.106838] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.106838] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.106838] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.106838] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.107901] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.107901] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.107901] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.107901] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.107901] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.107901] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.107901] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.107901] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.107901] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.107901] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.108511] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.108511] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ae2165fd-f83d-4e2c-9b0c-bc204ebfb5f2 is going to be updated. [ 978.138388] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.138581] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.138639] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.138800] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.139045] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.139233] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ae2165fd-f83d-4e2c-9b0c-bc204ebfb5f2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.256689] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-985 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.256885] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-985" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.257015] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-985" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.257293] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-985" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.257600] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.257731] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.257835] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.258056] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.258201] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.258407] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 978.258522] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 978.258633] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 978.258874] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 978.258874] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 978.258987] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 978.259078] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 978.281403] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 978.281403] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 978.281403] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 978.281403] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-985" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.281403] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-44f9dee5-5809-46ab-97b4-831b5466ca6a taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.281403] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-44f9dee5-5809-46ab-97b4-831b5466ca6a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.281403] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-44f9dee5-5809-46ab-97b4-831b5466ca6a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.281940] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-44f9dee5-5809-46ab-97b4-831b5466ca6a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.281940] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44f9dee5-5809-46ab-97b4-831b5466ca6a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.295621] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.295844] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.295844] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.342609] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.342609] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.342609] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.342609] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.342609] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.342609] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.342609] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.342609] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9410f01-20de-42de-8117-bdf11cf59643 already deleted. [ 978.342609] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9410f01-20de-42de-8117-bdf11cf59643" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.544979] env[70764]: INFO networking_nsxv3.common.synchronization [req-cd470d65-0239-4fb5-8e35-cc7dc411e8ec req-f6238a5c-5ae3-45cc-bd17-80bb49cef674 tempest-InstanceActionsNegativeTestJSON-652653537 tempest-InstanceActionsNegativeTestJSON-652653537-project-member] Enqueued Resource ID: 5ec7f171-db73-4bef-97dc-92782231e84b with Priority: HIGHEST for action security_group_members [ 978.545549] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ec7f171-db73-4bef-97dc-92782231e84b with Priority: HIGHEST for action security_group_members [ 978.545858] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ec7f171-db73-4bef-97dc-92782231e84b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.545986] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ec7f171-db73-4bef-97dc-92782231e84b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.546465] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ec7f171-db73-4bef-97dc-92782231e84b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.546685] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ec7f171-db73-4bef-97dc-92782231e84b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.546862] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.546987] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.547073] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.547281] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.547424] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.547551] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ec7f171-db73-4bef-97dc-92782231e84b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.610341] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.783862] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.784334] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.784334] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.784507] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.784660] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.784819] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 44f9dee5-5809-46ab-97b4-831b5466ca6a not found, creating... [ 978.785095] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.785259] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.785377] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.785592] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.785725] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.786009] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.786173] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.786381] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.786488] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.786622] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.786759] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 44f9dee5-5809-46ab-97b4-831b5466ca6a is going to be created. [ 978.805323] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.805543] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.805647] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.805920] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.806179] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.806402] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-44f9dee5-5809-46ab-97b4-831b5466ca6a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.050118] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.050303] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.050375] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.051029] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.051029] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.051029] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.051029] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.051029] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.051376] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.051376] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.051376] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ec7f171-db73-4bef-97dc-92782231e84b is going to be updated. [ 979.080359] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.080538] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.080588] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.080781] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.081587] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.089596] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ec7f171-db73-4bef-97dc-92782231e84b in Status: IN_PROGRESS for 2s [ 979.113071] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.113248] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.113319] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.113530] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.113678] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.113788] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b is going to be created. [ 979.136919] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.136919] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.136919] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.136919] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.136919] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.145765] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b in Status: UNINITIALIZED for 2s [ 979.548756] env[70764]: INFO networking_nsxv3.common.synchronization [req-7b0ce03b-7a37-45e0-a1f4-b13a63e400f7 req-3d574c92-401b-44d5-a531-cb1d212d4a91 service nova] Enqueued Resource ID: b9410f01-20de-42de-8117-bdf11cf59643 with Priority: HIGHEST for action security_group_rules [ 979.548756] env[70764]: INFO networking_nsxv3.common.synchronization [req-7b0ce03b-7a37-45e0-a1f4-b13a63e400f7 req-3d574c92-401b-44d5-a531-cb1d212d4a91 service nova] Enqueued Resource ID: b9410f01-20de-42de-8117-bdf11cf59643 with Priority: HIGHEST for action security_group_members [ 979.548886] env[70764]: INFO networking_nsxv3.common.synchronization [req-7b0ce03b-7a37-45e0-a1f4-b13a63e400f7 req-3d574c92-401b-44d5-a531-cb1d212d4a91 service nova] Enqueued Resource ID: 44f9dee5-5809-46ab-97b4-831b5466ca6a with Priority: HIGHEST for action port [ 979.549081] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9410f01-20de-42de-8117-bdf11cf59643 with Priority: HIGHEST for action security_group_rules [ 979.549517] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9410f01-20de-42de-8117-bdf11cf59643 with Priority: HIGHEST for action security_group_members [ 979.549517] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44f9dee5-5809-46ab-97b4-831b5466ca6a with Priority: HIGHEST for action port [ 979.549835] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b9410f01-20de-42de-8117-bdf11cf59643 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.549956] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b9410f01-20de-42de-8117-bdf11cf59643" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.550057] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b9410f01-20de-42de-8117-bdf11cf59643" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.550254] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b9410f01-20de-42de-8117-bdf11cf59643" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.550334] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b9410f01-20de-42de-8117-bdf11cf59643',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.551516] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9410f01-20de-42de-8117-bdf11cf59643 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.551645] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9410f01-20de-42de-8117-bdf11cf59643" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.551744] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9410f01-20de-42de-8117-bdf11cf59643" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.551899] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9410f01-20de-42de-8117-bdf11cf59643" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.552125] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.552225] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.552284] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.552426] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.552506] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.552595] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b9410f01-20de-42de-8117-bdf11cf59643',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.553341] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-44f9dee5-5809-46ab-97b4-831b5466ca6a taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.553445] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44f9dee5-5809-46ab-97b4-831b5466ca6a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.553510] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44f9dee5-5809-46ab-97b4-831b5466ca6a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.553655] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44f9dee5-5809-46ab-97b4-831b5466ca6a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.553728] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44f9dee5-5809-46ab-97b4-831b5466ca6a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.869020] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37e71aae-75a3-4784-89f9-86f606e096a1 in Status: SUCCESS [ 979.869335] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37e71aae-75a3-4784-89f9-86f606e096a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.055370] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9410f01-20de-42de-8117-bdf11cf59643 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.055514] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9410f01-20de-42de-8117-bdf11cf59643" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.055718] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b9410f01-20de-42de-8117-bdf11cf59643',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.056638] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 44f9dee5-5809-46ab-97b4-831b5466ca6a with status ACTIVE [ 980.056823] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.056938] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.057013] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.057216] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.057308] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.057474] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.057576] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.057646] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.057788] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.057865] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.058058] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.058155] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.058217] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.058357] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.058432] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.058562] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 44f9dee5-5809-46ab-97b4-831b5466ca6a is going to be updated. [ 980.077898] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.078050] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.078099] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.078279] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.078413] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.078571] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44f9dee5-5809-46ab-97b4-831b5466ca6a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.560270] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b9410f01-20de-42de-8117-bdf11cf59643',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.063591] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.063912] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.063912] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.064126] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.064222] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.064338] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9410f01-20de-42de-8117-bdf11cf59643 is going to be created. [ 981.087757] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.087929] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.087996] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.088235] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.088435] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.099967] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ec7f171-db73-4bef-97dc-92782231e84b in Status: SUCCESS [ 981.100351] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ec7f171-db73-4bef-97dc-92782231e84b deletion is rescheduled due to dependency. [ 981.100431] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ec7f171-db73-4bef-97dc-92782231e84b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.101278] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9410f01-20de-42de-8117-bdf11cf59643 in Status: UNINITIALIZED for 2s [ 981.160153] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b in Status: SUCCESS [ 981.160388] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.160560] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.160786] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.160994] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.161136] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.161204] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.161386] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.161469] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.161577] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.161673] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.663680] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.870363] env[70764]: INFO networking_nsxv3.common.synchronization [req-449a7d6c-6047-45af-b523-e42907f07eec req-5f7bb313-9127-45a2-8ab7-0cdad3adb5fa tempest-ServersTestJSON-88830314 tempest-ServersTestJSON-88830314-project-member] Enqueued Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_members [ 981.871530] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_members [ 981.871530] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.871530] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.871530] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.871832] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.872187] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.872328] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.872328] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.872461] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.872573] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.872684] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.166408] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b: rpc.has_security_group_logging(os_id): False [ 982.199333] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.199470] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.199559] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.199760] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.199864] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.200183] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.200334] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.200424] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.200578] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.200690] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.200753] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b is going to be created. [ 982.280722] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.280722] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.280722] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.280722] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.280722] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.308489] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b in Status: IN_PROGRESS for 2s [ 982.378794] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.881540] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.118210] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9410f01-20de-42de-8117-bdf11cf59643 in Status: UNINITIALIZED for 4s [ 983.206679] env[70764]: INFO networking_nsxv3.common.synchronization [req-d037749d-da4c-4144-b32f-4a6c9825fe14 req-4e3e4a7c-619b-4347-9d08-6e227a4781f4 tempest-ServerMetadataNegativeTestJSON-1659647714 tempest-ServerMetadataNegativeTestJSON-1659647714-project-member] Enqueued Resource ID: 3cd125ff-382e-4eec-ae57-a26a30a63320 with Priority: HIGHEST for action security_group_members [ 983.207226] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cd125ff-382e-4eec-ae57-a26a30a63320 with Priority: HIGHEST for action security_group_members [ 983.207556] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cd125ff-382e-4eec-ae57-a26a30a63320 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.207683] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cd125ff-382e-4eec-ae57-a26a30a63320" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.207770] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cd125ff-382e-4eec-ae57-a26a30a63320" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.208147] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cd125ff-382e-4eec-ae57-a26a30a63320" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.208344] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.208464] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.208529] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.208686] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.208768] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.208863] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3cd125ff-382e-4eec-ae57-a26a30a63320',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.383887] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.384076] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.384156] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.384372] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.384463] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.384562] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8f5efec-a14e-4be6-8add-7b35a995c982 is going to be updated. [ 983.425040] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.425342] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.425434] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.425879] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.426193] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.435767] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: IN_PROGRESS for 2s [ 983.710739] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.710985] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.710985] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.711198] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.711290] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.711496] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.711637] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.711735] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.711953] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.712067] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.712164] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cd125ff-382e-4eec-ae57-a26a30a63320 already deleted. [ 983.712249] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cd125ff-382e-4eec-ae57-a26a30a63320" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.929326] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-846 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.929326] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-846" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.929326] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-846" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.929485] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-846" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.929688] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.929881] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.930217] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.930549] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.930710] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.930952] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 983.931095] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 983.931212] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 983.931343] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 983.931510] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 983.931648] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 983.931790] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 983.954812] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 983.954989] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 983.955164] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 983.955348] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-846" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.955734] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-263849f3-ba3e-4895-977f-64631cdfc153 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.955922] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-263849f3-ba3e-4895-977f-64631cdfc153" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.956062] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-263849f3-ba3e-4895-977f-64631cdfc153" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.956414] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-263849f3-ba3e-4895-977f-64631cdfc153" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.956637] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('263849f3-ba3e-4895-977f-64631cdfc153',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.320713] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b in Status: SUCCESS [ 984.321057] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.463717] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.464232] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.464396] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.464901] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.465136] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.465326] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 263849f3-ba3e-4895-977f-64631cdfc153 not found, creating... [ 984.465632] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.465889] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.466095] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.466362] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.466575] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.466898] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.467076] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.467226] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.467473] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.467614] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.467815] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 263849f3-ba3e-4895-977f-64631cdfc153 is going to be created. [ 984.492836] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.493046] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.493176] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.493423] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.493668] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.493922] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-263849f3-ba3e-4895-977f-64631cdfc153" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.127971] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9410f01-20de-42de-8117-bdf11cf59643 in Status: SUCCESS [ 985.128304] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9410f01-20de-42de-8117-bdf11cf59643" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.128423] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9410f01-20de-42de-8117-bdf11cf59643" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.128687] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9410f01-20de-42de-8117-bdf11cf59643" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.128918] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.129070] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.129133] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.129532] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.129532] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.129532] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9410f01-20de-42de-8117-bdf11cf59643" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.129909] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b9410f01-20de-42de-8117-bdf11cf59643',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.457132] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: SUCCESS [ 985.457800] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.533026] env[70764]: INFO networking_nsxv3.common.synchronization [req-9c94b31f-c958-4774-b7d2-3cbd7046e787 req-ce9d2e0c-1c92-49f2-9fc9-8bbd44dd9ae9 tempest-ServerPasswordTestJSON-2135639814 tempest-ServerPasswordTestJSON-2135639814-project-member] Enqueued Resource ID: 37e71aae-75a3-4784-89f9-86f606e096a1 with Priority: HIGHEST for action security_group_members [ 985.533026] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37e71aae-75a3-4784-89f9-86f606e096a1 with Priority: HIGHEST for action security_group_members [ 985.533026] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-37e71aae-75a3-4784-89f9-86f606e096a1 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.533026] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37e71aae-75a3-4784-89f9-86f606e096a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.533351] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37e71aae-75a3-4784-89f9-86f606e096a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.533702] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37e71aae-75a3-4784-89f9-86f606e096a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.533979] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.534228] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.535527] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.535527] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.535527] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.535527] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37e71aae-75a3-4784-89f9-86f606e096a1',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.568141] env[70764]: INFO networking_nsxv3.common.synchronization [req-1562dcfc-3431-4181-9a15-ac6fd101cde1 req-8ccdb09f-b98b-461a-8de7-e9a6be3a1ef9 tempest-ServerDiskConfigTestJSON-1914051978 tempest-ServerDiskConfigTestJSON-1914051978-project-member] Enqueued Resource ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 with Priority: HIGHEST for action security_group_members [ 985.568141] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 with Priority: HIGHEST for action security_group_members [ 985.568141] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-56646d46-eb79-4ebc-a596-a5a17716f8e4 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.568141] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.568141] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.568141] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.568141] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.568141] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.568141] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.569574] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.569777] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.570074] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56646d46-eb79-4ebc-a596-a5a17716f8e4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.578270] env[70764]: INFO networking_nsxv3.common.synchronization [req-d037749d-da4c-4144-b32f-4a6c9825fe14 req-182c7f4c-b2d6-4861-9046-6d9a9cfce48b service nova] Enqueued Resource ID: 3cd125ff-382e-4eec-ae57-a26a30a63320 with Priority: HIGHEST for action security_group_rules [ 985.578270] env[70764]: INFO networking_nsxv3.common.synchronization [req-d037749d-da4c-4144-b32f-4a6c9825fe14 req-182c7f4c-b2d6-4861-9046-6d9a9cfce48b service nova] Enqueued Resource ID: 3cd125ff-382e-4eec-ae57-a26a30a63320 with Priority: HIGHEST for action security_group_members [ 985.578270] env[70764]: INFO networking_nsxv3.common.synchronization [req-d037749d-da4c-4144-b32f-4a6c9825fe14 req-182c7f4c-b2d6-4861-9046-6d9a9cfce48b service nova] Enqueued Resource ID: 263849f3-ba3e-4895-977f-64631cdfc153 with Priority: HIGHEST for action port [ 985.578270] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cd125ff-382e-4eec-ae57-a26a30a63320 with Priority: HIGHEST for action security_group_rules [ 985.578270] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cd125ff-382e-4eec-ae57-a26a30a63320 with Priority: HIGHEST for action security_group_members [ 985.578270] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 263849f3-ba3e-4895-977f-64631cdfc153 with Priority: HIGHEST for action port [ 985.578270] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3cd125ff-382e-4eec-ae57-a26a30a63320 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.578270] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3cd125ff-382e-4eec-ae57-a26a30a63320" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.578270] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3cd125ff-382e-4eec-ae57-a26a30a63320" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.578270] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3cd125ff-382e-4eec-ae57-a26a30a63320" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.578270] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3cd125ff-382e-4eec-ae57-a26a30a63320',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.579071] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cd125ff-382e-4eec-ae57-a26a30a63320 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.579343] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cd125ff-382e-4eec-ae57-a26a30a63320" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.579521] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cd125ff-382e-4eec-ae57-a26a30a63320" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.582210] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cd125ff-382e-4eec-ae57-a26a30a63320" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.582210] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.582210] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.582210] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.582210] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.582210] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.582210] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3cd125ff-382e-4eec-ae57-a26a30a63320',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.582210] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-263849f3-ba3e-4895-977f-64631cdfc153 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.582210] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-263849f3-ba3e-4895-977f-64631cdfc153" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.582210] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-263849f3-ba3e-4895-977f-64631cdfc153" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.582210] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-263849f3-ba3e-4895-977f-64631cdfc153" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.582210] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('263849f3-ba3e-4895-977f-64631cdfc153',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.632385] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b9410f01-20de-42de-8117-bdf11cf59643',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.864994] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-829 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.865235] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-829" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.865353] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-829" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.865624] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-829" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.865887] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.866054] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.866173] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.866390] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.866531] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.866737] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 985.866850] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 985.866959] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 985.867084] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 985.867193] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 985.867298] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 985.867431] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 985.889563] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 985.889563] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 985.889563] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 985.889563] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-829" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.890132] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-ecf4261e-a51f-4965-8ca0-c199803298ab taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.890346] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-ecf4261e-a51f-4965-8ca0-c199803298ab" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.891105] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-ecf4261e-a51f-4965-8ca0-c199803298ab" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.891105] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-ecf4261e-a51f-4965-8ca0-c199803298ab" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.891105] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ecf4261e-a51f-4965-8ca0-c199803298ab',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.036332] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.036499] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.036573] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.036795] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.036888] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.037112] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.037210] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.037274] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.037433] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.037531] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.037620] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37e71aae-75a3-4784-89f9-86f606e096a1 is going to be updated. [ 986.064748] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.064896] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.064973] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.065193] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.065327] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.073077] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37e71aae-75a3-4784-89f9-86f606e096a1 in Status: IN_PROGRESS for 2s [ 986.073383] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.073552] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.073612] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.073742] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.073842] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.074017] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.074133] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.074204] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.074351] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.074433] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.074520] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 is going to be updated. [ 986.083949] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cd125ff-382e-4eec-ae57-a26a30a63320 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.084061] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cd125ff-382e-4eec-ae57-a26a30a63320" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.085341] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3cd125ff-382e-4eec-ae57-a26a30a63320',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.086279] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 263849f3-ba3e-4895-977f-64631cdfc153 with status ACTIVE [ 986.086393] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.086512] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.086601] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.086756] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.086914] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.086998] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.086998] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.087250] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.087320] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.087387] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.087532] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.087649] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.087703] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.087811] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.087878] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.087962] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 263849f3-ba3e-4895-977f-64631cdfc153 is going to be updated. [ 986.103674] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.103825] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.103870] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.104460] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.104611] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.114034] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.114158] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.114245] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.114555] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.114721] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.114882] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-263849f3-ba3e-4895-977f-64631cdfc153" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.115901] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 in Status: IN_PROGRESS for 2s [ 986.135611] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b9410f01-20de-42de-8117-bdf11cf59643: rpc.has_security_group_logging(os_id): False [ 986.167832] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.168248] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.168248] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.168386] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.168476] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.169289] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.169289] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.169289] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.169289] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.169289] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.169289] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b9410f01-20de-42de-8117-bdf11cf59643 is going to be created. [ 986.296613] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.296823] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.296898] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.297165] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.297413] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.312062] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b9410f01-20de-42de-8117-bdf11cf59643 in Status: IN_PROGRESS for 2s [ 986.393202] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.393476] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.393610] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.393909] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.394071] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.394233] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port ecf4261e-a51f-4965-8ca0-c199803298ab not found, creating... [ 986.394548] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.394717] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.394868] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.395121] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.395215] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.395525] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.395683] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.395802] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.396213] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.396424] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.396714] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: ecf4261e-a51f-4965-8ca0-c199803298ab is going to be created. [ 986.432827] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.434317] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.434317] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.434657] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.435438] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.435884] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-ecf4261e-a51f-4965-8ca0-c199803298ab" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.590965] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3cd125ff-382e-4eec-ae57-a26a30a63320',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.095513] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.095513] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.095513] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.095513] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.095513] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.095513] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cd125ff-382e-4eec-ae57-a26a30a63320 is going to be created. [ 987.117432] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.117432] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.117432] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.117432] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.117432] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.124630] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cd125ff-382e-4eec-ae57-a26a30a63320 in Status: UNINITIALIZED for 2s [ 987.143550] env[70764]: INFO networking_nsxv3.common.synchronization [req-1562dcfc-3431-4181-9a15-ac6fd101cde1 req-b387ded5-0e67-4c80-9c73-6393a50b3f2b service nova] Enqueued Resource ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 with Priority: HIGHEST for action security_group_rules [ 987.143550] env[70764]: INFO networking_nsxv3.common.synchronization [req-1562dcfc-3431-4181-9a15-ac6fd101cde1 req-b387ded5-0e67-4c80-9c73-6393a50b3f2b service nova] Enqueued Resource ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 with Priority: HIGHEST for action security_group_members [ 987.144622] env[70764]: INFO networking_nsxv3.common.synchronization [req-1562dcfc-3431-4181-9a15-ac6fd101cde1 req-b387ded5-0e67-4c80-9c73-6393a50b3f2b service nova] Enqueued Resource ID: ecf4261e-a51f-4965-8ca0-c199803298ab with Priority: HIGHEST for action port [ 987.151150] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 with Priority: HIGHEST for action security_group_rules [ 987.151150] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 with Priority: HIGHEST for action security_group_members [ 987.151150] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecf4261e-a51f-4965-8ca0-c199803298ab with Priority: HIGHEST for action port [ 987.151150] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-56646d46-eb79-4ebc-a596-a5a17716f8e4 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.151150] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.151150] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.151150] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.151150] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('56646d46-eb79-4ebc-a596-a5a17716f8e4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.151150] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-56646d46-eb79-4ebc-a596-a5a17716f8e4 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.151150] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.151150] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-ecf4261e-a51f-4965-8ca0-c199803298ab taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.151150] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ecf4261e-a51f-4965-8ca0-c199803298ab" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.151150] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ecf4261e-a51f-4965-8ca0-c199803298ab" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.151150] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ecf4261e-a51f-4965-8ca0-c199803298ab" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.151150] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ecf4261e-a51f-4965-8ca0-c199803298ab',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.653494] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-56646d46-eb79-4ebc-a596-a5a17716f8e4 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.653799] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.653799] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ecf4261e-a51f-4965-8ca0-c199803298ab with status ACTIVE [ 987.653949] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.654091] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.654167] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.654368] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.654498] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.656277] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.656277] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.656277] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.656277] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.656277] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.656277] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.656277] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.656277] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.656277] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.656277] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.656277] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ecf4261e-a51f-4965-8ca0-c199803298ab is going to be updated. [ 987.680308] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.680516] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.680516] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.680704] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.680831] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.680978] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ecf4261e-a51f-4965-8ca0-c199803298ab" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.091040] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37e71aae-75a3-4784-89f9-86f606e096a1 in Status: SUCCESS [ 988.091285] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37e71aae-75a3-4784-89f9-86f606e096a1 deletion is rescheduled due to dependency. [ 988.091352] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37e71aae-75a3-4784-89f9-86f606e096a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.125509] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 in Status: SUCCESS [ 988.126039] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 deletion is rescheduled due to dependency. [ 988.126039] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.126039] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.126251] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.126429] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.126540] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.126878] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.126878] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.126878] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.127077] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56646d46-eb79-4ebc-a596-a5a17716f8e4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.152846] env[70764]: INFO networking_nsxv3.common.synchronization [req-c3d3d94d-10bc-49d7-a551-259266def78d req-7f1cf06e-4e6b-4f2e-8d2f-826e0431991d tempest-ServerTagsTestJSON-555351581 tempest-ServerTagsTestJSON-555351581-project-member] Enqueued Resource ID: bdd0180d-c388-4ba4-a117-13e93e3b0327 with Priority: HIGHEST for action security_group_members [ 988.153739] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdd0180d-c388-4ba4-a117-13e93e3b0327 with Priority: HIGHEST for action security_group_members [ 988.153739] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0180d-c388-4ba4-a117-13e93e3b0327 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.153884] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0180d-c388-4ba4-a117-13e93e3b0327" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.153884] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0180d-c388-4ba4-a117-13e93e3b0327" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.155079] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0180d-c388-4ba4-a117-13e93e3b0327" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.155079] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.155079] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.155079] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.155422] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.155422] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.155491] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdd0180d-c388-4ba4-a117-13e93e3b0327',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.326839] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b9410f01-20de-42de-8117-bdf11cf59643 in Status: SUCCESS [ 988.326839] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b9410f01-20de-42de-8117-bdf11cf59643" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.494834] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-455 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.495061] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-455" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.496139] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-455" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.496139] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-455" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.496139] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.496139] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.496139] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.496387] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.496588] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.496808] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 988.496920] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 988.497041] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 988.497670] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 988.497670] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 988.497670] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 988.497670] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 988.517398] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 988.519676] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 988.519676] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 988.519676] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-455" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.519676] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-e7c03980-1088-4084-8226-54065ea374a7 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.519676] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-e7c03980-1088-4084-8226-54065ea374a7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.519676] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-e7c03980-1088-4084-8226-54065ea374a7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.519676] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-e7c03980-1088-4084-8226-54065ea374a7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.519676] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7c03980-1088-4084-8226-54065ea374a7',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.629605] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('56646d46-eb79-4ebc-a596-a5a17716f8e4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.660500] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.660817] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.660817] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.660959] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.661059] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.661257] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.661357] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.661443] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.661653] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.661736] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.661824] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdd0180d-c388-4ba4-a117-13e93e3b0327 already deleted. [ 988.661931] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0180d-c388-4ba4-a117-13e93e3b0327" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.022185] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.022433] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.022563] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.022871] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.023065] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.023224] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port e7c03980-1088-4084-8226-54065ea374a7 not found, creating... [ 989.023504] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.023667] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.023786] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.024030] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.024180] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.024467] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.024627] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.024746] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.024956] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.025107] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.025249] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: e7c03980-1088-4084-8226-54065ea374a7 is going to be created. [ 989.045823] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.045823] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.045823] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.045823] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.045823] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.045823] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-e7c03980-1088-4084-8226-54065ea374a7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.132195] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('56646d46-eb79-4ebc-a596-a5a17716f8e4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.134979] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cd125ff-382e-4eec-ae57-a26a30a63320 in Status: UNINITIALIZED for 4s [ 989.635180] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.635368] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.635431] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.635613] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.635703] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.635801] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 is going to be updated. [ 989.670616] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.670922] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.670922] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.671064] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.671207] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.683528] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 in Status: IN_PROGRESS for 2s [ 989.763970] env[70764]: INFO networking_nsxv3.common.synchronization [req-c3d3d94d-10bc-49d7-a551-259266def78d req-bdffc251-dc84-4e70-a06d-240e928bb0f2 service nova] Enqueued Resource ID: bdd0180d-c388-4ba4-a117-13e93e3b0327 with Priority: HIGHEST for action security_group_rules [ 989.764052] env[70764]: INFO networking_nsxv3.common.synchronization [req-c3d3d94d-10bc-49d7-a551-259266def78d req-bdffc251-dc84-4e70-a06d-240e928bb0f2 service nova] Enqueued Resource ID: bdd0180d-c388-4ba4-a117-13e93e3b0327 with Priority: HIGHEST for action security_group_members [ 989.764171] env[70764]: INFO networking_nsxv3.common.synchronization [req-c3d3d94d-10bc-49d7-a551-259266def78d req-bdffc251-dc84-4e70-a06d-240e928bb0f2 service nova] Enqueued Resource ID: e7c03980-1088-4084-8226-54065ea374a7 with Priority: HIGHEST for action port [ 989.764922] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdd0180d-c388-4ba4-a117-13e93e3b0327 with Priority: HIGHEST for action security_group_rules [ 989.765028] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdd0180d-c388-4ba4-a117-13e93e3b0327 with Priority: HIGHEST for action security_group_members [ 989.765221] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7c03980-1088-4084-8226-54065ea374a7 with Priority: HIGHEST for action port [ 989.765588] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdd0180d-c388-4ba4-a117-13e93e3b0327 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.765676] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdd0180d-c388-4ba4-a117-13e93e3b0327" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.765723] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdd0180d-c388-4ba4-a117-13e93e3b0327" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.765969] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdd0180d-c388-4ba4-a117-13e93e3b0327" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.766059] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdd0180d-c388-4ba4-a117-13e93e3b0327',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.770022] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0180d-c388-4ba4-a117-13e93e3b0327 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.770022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0180d-c388-4ba4-a117-13e93e3b0327" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.770022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0180d-c388-4ba4-a117-13e93e3b0327" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.770022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0180d-c388-4ba4-a117-13e93e3b0327" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.770022] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.770022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.770022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.770022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.770022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.770022] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdd0180d-c388-4ba4-a117-13e93e3b0327',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.770745] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7c03980-1088-4084-8226-54065ea374a7 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.770745] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7c03980-1088-4084-8226-54065ea374a7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.770745] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7c03980-1088-4084-8226-54065ea374a7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.770745] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7c03980-1088-4084-8226-54065ea374a7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.770905] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7c03980-1088-4084-8226-54065ea374a7',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.268251] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0180d-c388-4ba4-a117-13e93e3b0327 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.268392] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0180d-c388-4ba4-a117-13e93e3b0327" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.270791] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdd0180d-c388-4ba4-a117-13e93e3b0327',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.273900] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e7c03980-1088-4084-8226-54065ea374a7 with status ACTIVE [ 990.274715] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.274715] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.274715] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.274715] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.274715] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.275088] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.275088] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.275088] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.275088] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.275223] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.275304] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.275382] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.275520] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.275567] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.275641] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.275714] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e7c03980-1088-4084-8226-54065ea374a7 is going to be updated. [ 990.299850] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.300017] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.300127] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.300344] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.300529] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.300724] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7c03980-1088-4084-8226-54065ea374a7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.775096] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdd0180d-c388-4ba4-a117-13e93e3b0327',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.146931] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cd125ff-382e-4eec-ae57-a26a30a63320 in Status: SUCCESS [ 991.146931] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cd125ff-382e-4eec-ae57-a26a30a63320" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.146931] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cd125ff-382e-4eec-ae57-a26a30a63320" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.147123] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cd125ff-382e-4eec-ae57-a26a30a63320" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.147163] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.147276] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.147337] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.147485] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.147562] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.147644] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cd125ff-382e-4eec-ae57-a26a30a63320" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.147734] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3cd125ff-382e-4eec-ae57-a26a30a63320',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.277612] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.277755] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.277844] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.278081] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.278199] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.278330] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdd0180d-c388-4ba4-a117-13e93e3b0327 is going to be created. [ 991.302468] env[70764]: INFO networking_nsxv3.common.synchronization [req-a46e46d2-971b-4ddc-819a-be543931e031 req-e6580028-141b-4bd0-af08-499972e3e265 tempest-AttachVolumeShelveTestJSON-384280106 tempest-AttachVolumeShelveTestJSON-384280106-project-member] Enqueued Resource ID: 9c661804-19d8-4b01-b7d8-b4d1885cc85f with Priority: HIGHEST for action security_group_members [ 991.303347] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c661804-19d8-4b01-b7d8-b4d1885cc85f with Priority: HIGHEST for action security_group_members [ 991.304835] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.305064] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.305237] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.305557] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.305815] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.307367] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c661804-19d8-4b01-b7d8-b4d1885cc85f taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.307533] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.307633] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.307896] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.308168] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.308287] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.308383] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.308600] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.308718] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.308846] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c661804-19d8-4b01-b7d8-b4d1885cc85f',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.329055] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdd0180d-c388-4ba4-a117-13e93e3b0327 in Status: UNINITIALIZED for 2s [ 991.652315] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cd125ff-382e-4eec-ae57-a26a30a63320 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.652593] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cd125ff-382e-4eec-ae57-a26a30a63320" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.652593] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cd125ff-382e-4eec-ae57-a26a30a63320" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.653244] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cd125ff-382e-4eec-ae57-a26a30a63320" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.653244] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.653244] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.653244] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.653244] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.655333] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.655333] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cd125ff-382e-4eec-ae57-a26a30a63320" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.655333] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cd125ff-382e-4eec-ae57-a26a30a63320 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.655333] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cd125ff-382e-4eec-ae57-a26a30a63320" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.655333] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cd125ff-382e-4eec-ae57-a26a30a63320" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.655333] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cd125ff-382e-4eec-ae57-a26a30a63320" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.655333] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.655333] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.655333] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.655333] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.655333] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.655333] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cd125ff-382e-4eec-ae57-a26a30a63320" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.655333] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3cd125ff-382e-4eec-ae57-a26a30a63320',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.690960] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 in Status: SUCCESS [ 991.692069] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.692069] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.692069] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.692069] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.692069] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.692069] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.692644] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.692644] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.692644] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.692644] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('56646d46-eb79-4ebc-a596-a5a17716f8e4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.814051] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.814051] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.814051] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.814051] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.814051] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.814051] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.814051] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.814051] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.814051] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.814051] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.814051] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c661804-19d8-4b01-b7d8-b4d1885cc85f is going to be updated. [ 991.840540] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.840689] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.842011] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.842011] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.842011] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.849814] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c661804-19d8-4b01-b7d8-b4d1885cc85f in Status: IN_PROGRESS for 2s [ 991.991375] env[70764]: INFO networking_nsxv3.common.synchronization [req-b2a661bb-d5ca-4b9a-9bcf-59b5873551ad req-f13b55c7-c8bd-4221-b856-7cc853a691bd tempest-ServerRescueNegativeTestJSON-1208111124 tempest-ServerRescueNegativeTestJSON-1208111124-project-member] Enqueued Resource ID: 1575c38c-2999-4e79-86e3-5e41e8eaa04a with Priority: HIGHEST for action security_group_members [ 991.991902] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1575c38c-2999-4e79-86e3-5e41e8eaa04a with Priority: HIGHEST for action security_group_members [ 991.992244] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-1575c38c-2999-4e79-86e3-5e41e8eaa04a taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.992367] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1575c38c-2999-4e79-86e3-5e41e8eaa04a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.992499] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1575c38c-2999-4e79-86e3-5e41e8eaa04a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.992630] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1575c38c-2999-4e79-86e3-5e41e8eaa04a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.992770] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.992866] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.992927] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.993112] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.993198] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.993290] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1575c38c-2999-4e79-86e3-5e41e8eaa04a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.159019] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3cd125ff-382e-4eec-ae57-a26a30a63320: rpc.has_security_group_logging(os_id): False [ 992.184618] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.184618] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.184618] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.184880] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.184919] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.185964] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.185964] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.185964] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.185964] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.185964] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.185964] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.185964] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.185964] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.185964] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.186427] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.186427] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.186427] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.186427] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.186550] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.186550] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.187294] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3cd125ff-382e-4eec-ae57-a26a30a63320 is going to be created. [ 992.195377] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-56646d46-eb79-4ebc-a596-a5a17716f8e4 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.195612] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.195612] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.195809] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.195978] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.196100] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.196182] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.196356] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.196444] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.197092] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.197092] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-56646d46-eb79-4ebc-a596-a5a17716f8e4 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.197092] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.197092] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.197092] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.197092] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.197326] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.197326] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.197478] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.197478] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.197665] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.197665] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('56646d46-eb79-4ebc-a596-a5a17716f8e4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.260562] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.265022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.265022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.265022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.265022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.277663] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3cd125ff-382e-4eec-ae57-a26a30a63320 in Status: IN_PROGRESS for 2s [ 992.496836] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.497055] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.497108] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.497294] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.497388] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.497590] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.497691] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.497764] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.497940] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.498017] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.498111] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1575c38c-2999-4e79-86e3-5e41e8eaa04a is going to be updated. [ 992.526165] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.526165] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.526165] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.526425] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.526540] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.534810] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1575c38c-2999-4e79-86e3-5e41e8eaa04a in Status: IN_PROGRESS for 2s [ 992.699911] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 56646d46-eb79-4ebc-a596-a5a17716f8e4: rpc.has_security_group_logging(os_id): False [ 992.720125] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.720274] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.721300] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.721300] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.721300] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.721300] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.721300] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.721300] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.721300] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.721300] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.721617] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.721617] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.721617] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.721712] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.722474] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.722474] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.722474] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.722474] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.722474] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.722474] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.722474] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 is going to be updated. [ 992.777242] env[70764]: INFO networking_nsxv3.common.synchronization [req-539ffffd-f987-4cdb-ad36-6b32061c55aa req-ed480e71-81d3-410d-ad55-f7b7006723c6 tempest-ListServersNegativeTestJSON-1304984611 tempest-ListServersNegativeTestJSON-1304984611-project-member] Enqueued Resource ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 with Priority: HIGHEST for action security_group_members [ 992.777242] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 with Priority: HIGHEST for action security_group_members [ 992.777242] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9995ac6-c7bb-4911-9b05-92ca94f2c030 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.777242] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.777242] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.777242] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.777242] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.777242] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.777242] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.777647] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.777647] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.777647] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9995ac6-c7bb-4911-9b05-92ca94f2c030',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.819248] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.819639] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.819639] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.819639] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.819824] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.833337] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 in Status: IN_PROGRESS for 2s [ 993.174814] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-89 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.174814] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-89" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.175422] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-89" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.175422] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-89" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.175512] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.175661] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.177414] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.177414] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.177414] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.177414] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 993.177414] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 993.177414] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 993.177414] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 993.177414] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 993.177414] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 993.177414] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 993.210650] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 993.210864] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 993.210977] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 993.211188] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-89" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.211517] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-25cfdbcc-b856-4912-b37e-b32f20ab04d2 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.211693] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-25cfdbcc-b856-4912-b37e-b32f20ab04d2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.211812] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-25cfdbcc-b856-4912-b37e-b32f20ab04d2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.212236] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-25cfdbcc-b856-4912-b37e-b32f20ab04d2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.212432] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25cfdbcc-b856-4912-b37e-b32f20ab04d2',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.279508] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.279508] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.279718] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.279791] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.279899] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.280134] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.280245] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.280310] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.280471] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.280550] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.280634] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 already deleted. [ 993.280713] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.338890] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdd0180d-c388-4ba4-a117-13e93e3b0327 in Status: SUCCESS [ 993.339024] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0180d-c388-4ba4-a117-13e93e3b0327" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.339152] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0180d-c388-4ba4-a117-13e93e3b0327" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.339384] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0180d-c388-4ba4-a117-13e93e3b0327" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.339594] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.339730] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.339813] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.339998] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.340110] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.340213] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0180d-c388-4ba4-a117-13e93e3b0327" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.340322] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bdd0180d-c388-4ba4-a117-13e93e3b0327',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.715277] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.716502] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.716502] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.716502] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.716502] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.716502] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 25cfdbcc-b856-4912-b37e-b32f20ab04d2 not found, creating... [ 993.716502] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.716957] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.716957] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.717042] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.717125] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.717535] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.717611] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.717718] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.717925] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.718072] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.718215] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 25cfdbcc-b856-4912-b37e-b32f20ab04d2 is going to be created. [ 993.738626] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.738831] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.739678] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.739678] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.739678] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.739806] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-25cfdbcc-b856-4912-b37e-b32f20ab04d2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.842197] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0180d-c388-4ba4-a117-13e93e3b0327 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.842506] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0180d-c388-4ba4-a117-13e93e3b0327" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.842506] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0180d-c388-4ba4-a117-13e93e3b0327" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.842733] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0180d-c388-4ba4-a117-13e93e3b0327" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.842938] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.843060] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.843163] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.843361] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.843476] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.843599] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0180d-c388-4ba4-a117-13e93e3b0327" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.843773] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0180d-c388-4ba4-a117-13e93e3b0327 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.843909] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0180d-c388-4ba4-a117-13e93e3b0327" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.843989] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0180d-c388-4ba4-a117-13e93e3b0327" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.844210] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0180d-c388-4ba4-a117-13e93e3b0327" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.844427] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.844554] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.844628] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.844825] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.844898] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.845038] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0180d-c388-4ba4-a117-13e93e3b0327" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.845119] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bdd0180d-c388-4ba4-a117-13e93e3b0327',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.858813] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c661804-19d8-4b01-b7d8-b4d1885cc85f in Status: SUCCESS [ 993.859024] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c661804-19d8-4b01-b7d8-b4d1885cc85f deletion is rescheduled due to dependency. [ 993.859134] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.290426] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3cd125ff-382e-4eec-ae57-a26a30a63320 in Status: SUCCESS [ 994.290661] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3cd125ff-382e-4eec-ae57-a26a30a63320" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.347424] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bdd0180d-c388-4ba4-a117-13e93e3b0327: rpc.has_security_group_logging(os_id): False [ 994.365340] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.365505] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.365581] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.365875] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.365975] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.366212] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.366357] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.366431] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.366591] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.366671] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.366865] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.366959] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.367032] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.367177] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.367252] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.367438] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.367533] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.367597] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.367734] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.367808] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.367894] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdd0180d-c388-4ba4-a117-13e93e3b0327 is going to be created. [ 994.424104] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.424300] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.424348] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.424562] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.424754] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.437081] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdd0180d-c388-4ba4-a117-13e93e3b0327 in Status: IN_PROGRESS for 2s [ 994.452134] env[70764]: INFO networking_nsxv3.common.synchronization [req-539ffffd-f987-4cdb-ad36-6b32061c55aa req-75cab45f-42d0-40f9-b096-7c008777b868 service nova] Enqueued Resource ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 with Priority: HIGHEST for action security_group_rules [ 994.452373] env[70764]: INFO networking_nsxv3.common.synchronization [req-539ffffd-f987-4cdb-ad36-6b32061c55aa req-75cab45f-42d0-40f9-b096-7c008777b868 service nova] Enqueued Resource ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 with Priority: HIGHEST for action security_group_members [ 994.452548] env[70764]: INFO networking_nsxv3.common.synchronization [req-539ffffd-f987-4cdb-ad36-6b32061c55aa req-75cab45f-42d0-40f9-b096-7c008777b868 service nova] Enqueued Resource ID: 25cfdbcc-b856-4912-b37e-b32f20ab04d2 with Priority: HIGHEST for action port [ 994.453200] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 with Priority: HIGHEST for action security_group_rules [ 994.453539] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 with Priority: HIGHEST for action security_group_members [ 994.453626] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25cfdbcc-b856-4912-b37e-b32f20ab04d2 with Priority: HIGHEST for action port [ 994.454033] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9995ac6-c7bb-4911-9b05-92ca94f2c030 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.454171] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.454253] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.454556] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.454653] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9995ac6-c7bb-4911-9b05-92ca94f2c030',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.455553] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9995ac6-c7bb-4911-9b05-92ca94f2c030 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.455678] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.455754] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.456409] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.456552] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.456676] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.456735] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.457038] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.457038] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.457182] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9995ac6-c7bb-4911-9b05-92ca94f2c030',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.458084] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-25cfdbcc-b856-4912-b37e-b32f20ab04d2 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.458084] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-25cfdbcc-b856-4912-b37e-b32f20ab04d2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.458305] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-25cfdbcc-b856-4912-b37e-b32f20ab04d2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.458510] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-25cfdbcc-b856-4912-b37e-b32f20ab04d2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.458598] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25cfdbcc-b856-4912-b37e-b32f20ab04d2',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.551071] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1575c38c-2999-4e79-86e3-5e41e8eaa04a in Status: SUCCESS [ 994.551265] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1575c38c-2999-4e79-86e3-5e41e8eaa04a deletion is rescheduled due to dependency. [ 994.551389] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1575c38c-2999-4e79-86e3-5e41e8eaa04a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.856678] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 in Status: SUCCESS [ 994.856678] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.964246] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9995ac6-c7bb-4911-9b05-92ca94f2c030 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.964246] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.964246] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9995ac6-c7bb-4911-9b05-92ca94f2c030',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.964246] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 25cfdbcc-b856-4912-b37e-b32f20ab04d2 with status ACTIVE [ 994.964246] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.964246] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.964246] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.964246] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.964246] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.964246] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.964246] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.964246] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.964246] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.964246] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.964690] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.964690] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.964690] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.964690] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.964690] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.964690] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 25cfdbcc-b856-4912-b37e-b32f20ab04d2 is going to be updated. [ 994.988959] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.989158] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.989228] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.989384] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.989515] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.989672] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-25cfdbcc-b856-4912-b37e-b32f20ab04d2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.298677] env[70764]: INFO networking_nsxv3.common.synchronization [req-539ffffd-f987-4cdb-ad36-6b32061c55aa req-438ff2fd-de05-41f3-af4f-ff5222ab8f1a tempest-ListServersNegativeTestJSON-1304984611 tempest-ListServersNegativeTestJSON-1304984611-project-member] Enqueued Resource ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 with Priority: HIGHEST for action security_group_members [ 995.299214] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 with Priority: HIGHEST for action security_group_members [ 995.299518] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9995ac6-c7bb-4911-9b05-92ca94f2c030 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.299622] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.466341] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9995ac6-c7bb-4911-9b05-92ca94f2c030',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.580282] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-89 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.580482] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-89" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.580604] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-89" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.580877] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-89" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.581145] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.581306] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.581427] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.581695] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.581887] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.582314] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 995.582443] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 995.582561] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 995.582678] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 995.582802] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 995.582919] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 995.583075] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 995.604729] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 995.604910] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 995.605074] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 995.605268] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-89" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.605588] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-fa676545-14a4-4942-a57e-a63c2fa781f8 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.605766] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-fa676545-14a4-4942-a57e-a63c2fa781f8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.605962] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-fa676545-14a4-4942-a57e-a63c2fa781f8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.606233] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-fa676545-14a4-4942-a57e-a63c2fa781f8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.606376] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa676545-14a4-4942-a57e-a63c2fa781f8',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.969509] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.969509] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.969509] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.969823] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.969823] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.969896] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 is going to be created. [ 995.993361] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.993565] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.993690] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.993816] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.993978] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.005066] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 in Status: UNINITIALIZED for 2s [ 996.109025] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.109285] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.109410] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.109737] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.110069] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.110326] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port fa676545-14a4-4942-a57e-a63c2fa781f8 not found, creating... [ 996.110618] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.110788] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.110911] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.111197] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.111348] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.111657] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.111824] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.111946] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.112246] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.112393] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.112530] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: fa676545-14a4-4942-a57e-a63c2fa781f8 is going to be created. [ 996.133056] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.133241] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.133416] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.133679] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.133902] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.134135] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-fa676545-14a4-4942-a57e-a63c2fa781f8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.455161] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdd0180d-c388-4ba4-a117-13e93e3b0327 in Status: SUCCESS [ 996.455547] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdd0180d-c388-4ba4-a117-13e93e3b0327" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.700714] env[70764]: INFO networking_nsxv3.common.synchronization [req-2681d4f8-2b88-4713-98ff-9334f52535a9 req-297b6392-df7f-46d0-b55e-56f438063d88 tempest-ServerMetadataNegativeTestJSON-1659647714 tempest-ServerMetadataNegativeTestJSON-1659647714-project-member] Enqueued Resource ID: 3cd125ff-382e-4eec-ae57-a26a30a63320 with Priority: HIGHEST for action security_group_members [ 996.700714] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cd125ff-382e-4eec-ae57-a26a30a63320 with Priority: HIGHEST for action security_group_members [ 996.700970] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cd125ff-382e-4eec-ae57-a26a30a63320 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.701151] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cd125ff-382e-4eec-ae57-a26a30a63320" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.701215] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cd125ff-382e-4eec-ae57-a26a30a63320" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.701374] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cd125ff-382e-4eec-ae57-a26a30a63320" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.701631] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.701736] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.701798] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.701946] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.702057] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.702153] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3cd125ff-382e-4eec-ae57-a26a30a63320',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.980137] env[70764]: INFO networking_nsxv3.common.synchronization [req-539ffffd-f987-4cdb-ad36-6b32061c55aa req-baf79d5d-ac1e-43af-976f-a5f1467f5160 service nova] Enqueued Resource ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 with Priority: HIGHEST for action security_group_rules [ 996.980415] env[70764]: INFO networking_nsxv3.common.synchronization [req-539ffffd-f987-4cdb-ad36-6b32061c55aa req-baf79d5d-ac1e-43af-976f-a5f1467f5160 service nova] Enqueued Resource ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 with Priority: HIGHEST for action security_group_members [ 996.980469] env[70764]: INFO networking_nsxv3.common.synchronization [req-539ffffd-f987-4cdb-ad36-6b32061c55aa req-baf79d5d-ac1e-43af-976f-a5f1467f5160 service nova] Enqueued Resource ID: fa676545-14a4-4942-a57e-a63c2fa781f8 with Priority: HIGHEST for action port [ 996.980680] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 with Priority: HIGHEST for action security_group_rules [ 996.980781] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 with Priority: HIGHEST for action security_group_members [ 996.980902] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa676545-14a4-4942-a57e-a63c2fa781f8 with Priority: HIGHEST for action port [ 996.982097] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9995ac6-c7bb-4911-9b05-92ca94f2c030 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.982097] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.982097] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9995ac6-c7bb-4911-9b05-92ca94f2c030 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.982097] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.982097] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa676545-14a4-4942-a57e-a63c2fa781f8 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.982364] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa676545-14a4-4942-a57e-a63c2fa781f8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.982364] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa676545-14a4-4942-a57e-a63c2fa781f8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.984329] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa676545-14a4-4942-a57e-a63c2fa781f8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.984329] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa676545-14a4-4942-a57e-a63c2fa781f8',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.204029] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.204213] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.204319] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.204542] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.204636] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.204843] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.204947] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.205015] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.205166] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.205242] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.205326] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cd125ff-382e-4eec-ae57-a26a30a63320 is going to be updated. [ 997.261667] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.261838] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.261934] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.262223] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.262381] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.271575] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cd125ff-382e-4eec-ae57-a26a30a63320 in Status: IN_PROGRESS for 2s [ 997.485204] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fa676545-14a4-4942-a57e-a63c2fa781f8 with status ACTIVE [ 997.485658] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.485932] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.486303] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.486706] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.487779] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.487911] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.488271] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.488576] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.489571] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.489571] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.490140] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.490399] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.490564] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.490976] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.491258] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.491459] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fa676545-14a4-4942-a57e-a63c2fa781f8 is going to be updated. [ 997.513051] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.513332] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.513413] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.513627] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.513778] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.513947] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa676545-14a4-4942-a57e-a63c2fa781f8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.773146] env[70764]: INFO networking_nsxv3.common.synchronization [req-539ffffd-f987-4cdb-ad36-6b32061c55aa req-d36ec5f4-98af-474d-af55-f1b5f962eb00 tempest-ListServersNegativeTestJSON-1304984611 tempest-ListServersNegativeTestJSON-1304984611-project-member] Enqueued Resource ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 with Priority: HIGHEST for action security_group_members [ 997.773851] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 with Priority: HIGHEST for action security_group_members [ 997.775173] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9995ac6-c7bb-4911-9b05-92ca94f2c030 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.775173] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.014956] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 in Status: SUCCESS [ 998.014956] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.014956] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.014956] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.016071] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.016220] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.016292] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.016464] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.016548] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.016646] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.016726] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a9995ac6-c7bb-4911-9b05-92ca94f2c030',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.019400] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.019640] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.019818] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.019943] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.020043] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.020203] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.020276] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.020374] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9995ac6-c7bb-4911-9b05-92ca94f2c030',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.104044] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-89 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.104044] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-89" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.104044] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-89" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.104044] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-89" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.104044] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.104044] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.104044] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.104044] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.104044] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.104044] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 998.104044] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 998.104856] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 998.105134] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 998.105403] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 998.105712] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 998.108021] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 998.126026] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 998.126026] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 998.126026] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 998.126026] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-89" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.126026] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-8c01a1f5-ce33-4242-8506-7aef8d537351 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.126026] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-8c01a1f5-ce33-4242-8506-7aef8d537351" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.126026] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-8c01a1f5-ce33-4242-8506-7aef8d537351" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.126026] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-8c01a1f5-ce33-4242-8506-7aef8d537351" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.126026] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c01a1f5-ce33-4242-8506-7aef8d537351',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.522865] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9995ac6-c7bb-4911-9b05-92ca94f2c030 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.523053] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.525455] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9995ac6-c7bb-4911-9b05-92ca94f2c030',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.628971] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.629227] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.629359] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.629641] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.629790] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.630023] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 8c01a1f5-ce33-4242-8506-7aef8d537351 not found, creating... [ 998.630293] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.630456] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.630576] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.630799] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.630936] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.631238] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.631402] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.631521] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.631727] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.631885] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.632071] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 8c01a1f5-ce33-4242-8506-7aef8d537351 is going to be created. [ 998.651601] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.651873] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.652128] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.652428] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.652716] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.653535] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-8c01a1f5-ce33-4242-8506-7aef8d537351" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.028942] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9995ac6-c7bb-4911-9b05-92ca94f2c030',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.283718] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cd125ff-382e-4eec-ae57-a26a30a63320 in Status: SUCCESS [ 999.284062] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cd125ff-382e-4eec-ae57-a26a30a63320 deletion is rescheduled due to dependency. [ 999.284326] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cd125ff-382e-4eec-ae57-a26a30a63320" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.406596] env[70764]: INFO networking_nsxv3.common.synchronization [req-539ffffd-f987-4cdb-ad36-6b32061c55aa req-0fa92ede-7b20-4a9d-8865-5e500656e799 service nova] Enqueued Resource ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 with Priority: HIGHEST for action security_group_rules [ 999.406752] env[70764]: INFO networking_nsxv3.common.synchronization [req-539ffffd-f987-4cdb-ad36-6b32061c55aa req-0fa92ede-7b20-4a9d-8865-5e500656e799 service nova] Enqueued Resource ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 with Priority: HIGHEST for action security_group_members [ 999.406976] env[70764]: INFO networking_nsxv3.common.synchronization [req-539ffffd-f987-4cdb-ad36-6b32061c55aa req-0fa92ede-7b20-4a9d-8865-5e500656e799 service nova] Enqueued Resource ID: 8c01a1f5-ce33-4242-8506-7aef8d537351 with Priority: HIGHEST for action port [ 999.407645] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 with Priority: HIGHEST for action security_group_rules [ 999.407811] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 with Priority: HIGHEST for action security_group_members [ 999.407944] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c01a1f5-ce33-4242-8506-7aef8d537351 with Priority: HIGHEST for action port [ 999.408509] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9995ac6-c7bb-4911-9b05-92ca94f2c030 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.409183] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.409183] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9995ac6-c7bb-4911-9b05-92ca94f2c030 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.409183] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.409498] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c01a1f5-ce33-4242-8506-7aef8d537351 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.409559] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c01a1f5-ce33-4242-8506-7aef8d537351" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.409636] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c01a1f5-ce33-4242-8506-7aef8d537351" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.410245] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c01a1f5-ce33-4242-8506-7aef8d537351" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.412674] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c01a1f5-ce33-4242-8506-7aef8d537351',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.531710] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.531878] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.531953] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.532988] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.533148] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.533312] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 is going to be updated. [ 999.586706] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.586898] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.587028] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.587320] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.587320] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.609820] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 in Status: IN_PROGRESS for 2s [ 999.916621] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8c01a1f5-ce33-4242-8506-7aef8d537351 with status ACTIVE [ 999.916621] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.916621] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.916621] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.916621] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.916621] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.916621] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.916621] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.916621] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.916621] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.916621] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.916621] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.916621] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.916621] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.916621] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.916621] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.916621] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8c01a1f5-ce33-4242-8506-7aef8d537351 is going to be updated. [ 999.934915] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.935077] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.935228] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.935479] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.935564] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.936384] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c01a1f5-ce33-4242-8506-7aef8d537351" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.620386] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 in Status: SUCCESS [ 1001.620714] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.620891] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.621141] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.621869] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.621869] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.621869] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.621869] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.621869] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.621869] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9995ac6-c7bb-4911-9b05-92ca94f2c030',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.698440] env[70764]: INFO networking_nsxv3.common.synchronization [req-5b050a9b-dc41-4199-b896-b37dba84d3de req-dd6168f2-f562-4e28-b83e-1110429f39c8 tempest-ServerTagsTestJSON-555351581 tempest-ServerTagsTestJSON-555351581-project-member] Enqueued Resource ID: bdd0180d-c388-4ba4-a117-13e93e3b0327 with Priority: HIGHEST for action security_group_members [ 1001.699306] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdd0180d-c388-4ba4-a117-13e93e3b0327 with Priority: HIGHEST for action security_group_members [ 1001.699412] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0180d-c388-4ba4-a117-13e93e3b0327 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.699585] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0180d-c388-4ba4-a117-13e93e3b0327" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.699656] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0180d-c388-4ba4-a117-13e93e3b0327" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.699815] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0180d-c388-4ba4-a117-13e93e3b0327" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.700232] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.704090] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.704237] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.704425] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.704520] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.704595] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdd0180d-c388-4ba4-a117-13e93e3b0327',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.125050] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9995ac6-c7bb-4911-9b05-92ca94f2c030',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.207986] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.208260] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.208319] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.208506] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.208599] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.208798] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.208895] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.208958] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.209118] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.209331] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.209331] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdd0180d-c388-4ba4-a117-13e93e3b0327 is going to be updated. [ 1002.237377] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.237487] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.237487] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.237753] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.237938] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.245880] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdd0180d-c388-4ba4-a117-13e93e3b0327 in Status: IN_PROGRESS for 2s [ 1002.604257] env[70764]: INFO networking_nsxv3.common.synchronization [req-1f0c6a3a-a304-49d0-bfcc-f9d0617a6604 req-78bbf426-4272-44ce-ab90-8ee69ebd02d9 tempest-ImagesTestJSON-1647743380 tempest-ImagesTestJSON-1647743380-project-member] Enqueued Resource ID: 4580d502-1d18-4681-96a4-28ac4e291d69 with Priority: HIGHEST for action security_group_members [ 1002.604794] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4580d502-1d18-4681-96a4-28ac4e291d69 with Priority: HIGHEST for action security_group_members [ 1002.605167] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4580d502-1d18-4681-96a4-28ac4e291d69 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.605336] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.605436] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.605669] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.605863] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.606012] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.606111] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.606309] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.606423] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.606544] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4580d502-1d18-4681-96a4-28ac4e291d69',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.628207] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9995ac6-c7bb-4911-9b05-92ca94f2c030',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.110136] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.110367] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.110429] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.110613] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.110701] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.110905] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.111013] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.111081] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.111226] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.111302] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.111388] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4580d502-1d18-4681-96a4-28ac4e291d69 is going to be updated. [ 1003.131478] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.131684] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.131768] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.131960] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.132145] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.132305] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 is going to be updated. [ 1003.140501] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.140762] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.140762] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.140984] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.141211] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.152026] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4580d502-1d18-4681-96a4-28ac4e291d69 in Status: IN_PROGRESS for 2s [ 1003.159209] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.159398] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.159560] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.159666] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.159799] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.169481] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 in Status: IN_PROGRESS for 2s [ 1003.813399] env[70764]: INFO networking_nsxv3.common.synchronization [None req-5bca20e3-d3bc-45ff-b27d-61ef2a47de43 None None] Enqueued Resource ID: 4c9978f2-779e-43cc-a89b-281d84b2320c with Priority: HIGHEST for action port [ 1003.813698] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c9978f2-779e-43cc-a89b-281d84b2320c with Priority: HIGHEST for action port [ 1003.814334] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c9978f2-779e-43cc-a89b-281d84b2320c taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.814476] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c9978f2-779e-43cc-a89b-281d84b2320c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.814547] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c9978f2-779e-43cc-a89b-281d84b2320c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.814793] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c9978f2-779e-43cc-a89b-281d84b2320c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.814875] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c9978f2-779e-43cc-a89b-281d84b2320c',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.983266] env[70764]: INFO networking_nsxv3.common.synchronization [None req-50d544f6-f9d5-4367-8e73-ac34a96a5266 tempest-AttachVolumeTestJSON-503324066 tempest-AttachVolumeTestJSON-503324066-project-member] Enqueued Resource ID: 46c016e6-244a-4247-9a9f-a7b0e21f0989 with Priority: HIGHEST for action security_group_rules [ 1003.983266] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46c016e6-244a-4247-9a9f-a7b0e21f0989 with Priority: HIGHEST for action security_group_rules [ 1003.983266] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46c016e6-244a-4247-9a9f-a7b0e21f0989 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.983266] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46c016e6-244a-4247-9a9f-a7b0e21f0989" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.983266] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46c016e6-244a-4247-9a9f-a7b0e21f0989" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.983266] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46c016e6-244a-4247-9a9f-a7b0e21f0989" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.983266] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46c016e6-244a-4247-9a9f-a7b0e21f0989',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.054977] env[70764]: INFO networking_nsxv3.common.synchronization [None req-36aeec33-74ca-4416-9871-d03bde407332 tempest-AttachVolumeTestJSON-503324066 tempest-AttachVolumeTestJSON-503324066-project-member] Enqueued Resource ID: 46c016e6-244a-4247-9a9f-a7b0e21f0989 with Priority: HIGHEST for action security_group_rules [ 1004.055511] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46c016e6-244a-4247-9a9f-a7b0e21f0989 with Priority: HIGHEST for action security_group_rules [ 1004.057030] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46c016e6-244a-4247-9a9f-a7b0e21f0989 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.057030] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46c016e6-244a-4247-9a9f-a7b0e21f0989" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.256929] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdd0180d-c388-4ba4-a117-13e93e3b0327 in Status: SUCCESS [ 1004.257137] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdd0180d-c388-4ba4-a117-13e93e3b0327 deletion is rescheduled due to dependency. [ 1004.257254] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0180d-c388-4ba4-a117-13e93e3b0327" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.317166] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4c9978f2-779e-43cc-a89b-281d84b2320c [ 1004.317404] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.317540] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.317609] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.317825] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.317953] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.317998] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4c9978f2-779e-43cc-a89b-281d84b2320c already deleted. [ 1004.318095] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c9978f2-779e-43cc-a89b-281d84b2320c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.505423] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.505685] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.505685] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.505923] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.506043] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.506147] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46c016e6-244a-4247-9a9f-a7b0e21f0989 already deleted. [ 1004.506241] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46c016e6-244a-4247-9a9f-a7b0e21f0989" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.506442] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46c016e6-244a-4247-9a9f-a7b0e21f0989" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.507024] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46c016e6-244a-4247-9a9f-a7b0e21f0989" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.507024] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46c016e6-244a-4247-9a9f-a7b0e21f0989',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.028996] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.028996] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.028996] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.028996] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.028996] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.028996] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46c016e6-244a-4247-9a9f-a7b0e21f0989 already deleted. [ 1005.028996] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46c016e6-244a-4247-9a9f-a7b0e21f0989" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.158935] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4580d502-1d18-4681-96a4-28ac4e291d69 in Status: SUCCESS [ 1005.158935] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4580d502-1d18-4681-96a4-28ac4e291d69 deletion is rescheduled due to dependency. [ 1005.158935] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.185070] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 in Status: SUCCESS [ 1005.185292] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.185493] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.185731] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.189563] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.189563] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.189563] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.189741] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.189802] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.189937] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9995ac6-c7bb-4911-9b05-92ca94f2c030',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.692515] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9995ac6-c7bb-4911-9b05-92ca94f2c030',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.042831] env[70764]: INFO networking_nsxv3.common.synchronization [None req-9714e2ee-a614-4c7b-875e-f87ed5045175 None None] Enqueued Resource ID: ae6f6d06-b66f-42cd-84b9-5012fb2d34b4 with Priority: HIGHEST for action port [ 1006.043392] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae6f6d06-b66f-42cd-84b9-5012fb2d34b4 with Priority: HIGHEST for action port [ 1006.043692] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae6f6d06-b66f-42cd-84b9-5012fb2d34b4 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.043812] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae6f6d06-b66f-42cd-84b9-5012fb2d34b4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.043876] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae6f6d06-b66f-42cd-84b9-5012fb2d34b4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.047453] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae6f6d06-b66f-42cd-84b9-5012fb2d34b4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.047545] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae6f6d06-b66f-42cd-84b9-5012fb2d34b4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.194523] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9995ac6-c7bb-4911-9b05-92ca94f2c030',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.554724] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ae6f6d06-b66f-42cd-84b9-5012fb2d34b4 [ 1006.554724] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.554724] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.554724] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.554724] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.554724] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.554724] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ae6f6d06-b66f-42cd-84b9-5012fb2d34b4 already deleted. [ 1006.554724] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ae6f6d06-b66f-42cd-84b9-5012fb2d34b4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.696378] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.696546] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.696618] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.696830] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.696917] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.697252] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 is going to be updated. [ 1006.708576] env[70764]: INFO networking_nsxv3.common.synchronization [None req-11248b54-17e0-4542-b3d6-00c540c42ebd None None] Enqueued Resource ID: e9ce1656-732a-423e-927e-1ff19036c875 with Priority: HIGHEST for action port [ 1006.708843] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9ce1656-732a-423e-927e-1ff19036c875 with Priority: HIGHEST for action port [ 1006.709456] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9ce1656-732a-423e-927e-1ff19036c875 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.709613] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9ce1656-732a-423e-927e-1ff19036c875" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.709682] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9ce1656-732a-423e-927e-1ff19036c875" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.710380] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9ce1656-732a-423e-927e-1ff19036c875" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.712359] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9ce1656-732a-423e-927e-1ff19036c875',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.723945] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.723945] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.724231] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.724519] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.724674] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.732466] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 in Status: IN_PROGRESS for 2s [ 1007.215355] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e9ce1656-732a-423e-927e-1ff19036c875 [ 1007.215650] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.215713] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.215789] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.215999] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.216133] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.216244] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e9ce1656-732a-423e-927e-1ff19036c875 already deleted. [ 1007.216341] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9ce1656-732a-423e-927e-1ff19036c875" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.272362] env[70764]: INFO networking_nsxv3.common.synchronization [req-8c6a593a-2991-4321-b76b-f39af3df1cbf req-7fd6d76c-b80a-4322-9d9c-bb0a889f522f tempest-DeleteServersTestJSON-1788501793 tempest-DeleteServersTestJSON-1788501793-project-member] Enqueued Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGHEST for action security_group_members [ 1007.273989] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGHEST for action security_group_members [ 1007.273989] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-3379805b-13ae-4057-9511-570e8b3c2437 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.273989] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.273989] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.273989] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.273989] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.273989] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.277924] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.277924] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.277924] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.277924] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3379805b-13ae-4057-9511-570e8b3c2437',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.685134] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-974 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.685134] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-974" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.685134] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-974" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.685134] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-974" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.685574] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.685846] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.686137] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.686541] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.686752] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.687080] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1007.687278] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1007.687470] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1007.687665] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1007.687860] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1007.688083] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1007.688355] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1007.710227] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1007.710368] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1007.710511] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1007.710691] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-974" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.711028] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-191e2435-97b6-4df4-bf52-8ed36a5df066 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.711319] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-191e2435-97b6-4df4-bf52-8ed36a5df066" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.711319] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-191e2435-97b6-4df4-bf52-8ed36a5df066" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.711649] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-191e2435-97b6-4df4-bf52-8ed36a5df066" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.711792] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('191e2435-97b6-4df4-bf52-8ed36a5df066',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.778082] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.778466] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.778466] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.778811] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.778811] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.778911] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.778967] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.779055] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.779276] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.779276] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.779338] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3379805b-13ae-4057-9511-570e8b3c2437 is going to be updated. [ 1007.804731] env[70764]: INFO networking_nsxv3.common.synchronization [None req-d77d67c7-b3e7-4df7-a887-635fc520a120 tempest-VolumesAdminNegativeTest-2021792328 tempest-VolumesAdminNegativeTest-2021792328-project-member] Enqueued Resource ID: 025fa550-df80-4c1b-a8f7-f75221e3bef7 with Priority: HIGHEST for action security_group_rules [ 1007.805799] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 025fa550-df80-4c1b-a8f7-f75221e3bef7 with Priority: HIGHEST for action security_group_rules [ 1007.807175] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.807304] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.809120] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.809120] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.809120] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.809120] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-025fa550-df80-4c1b-a8f7-f75221e3bef7 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.809120] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-025fa550-df80-4c1b-a8f7-f75221e3bef7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.809120] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-025fa550-df80-4c1b-a8f7-f75221e3bef7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.809408] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-025fa550-df80-4c1b-a8f7-f75221e3bef7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.809408] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('025fa550-df80-4c1b-a8f7-f75221e3bef7',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.818184] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3379805b-13ae-4057-9511-570e8b3c2437 in Status: IN_PROGRESS for 2s [ 1007.895944] env[70764]: INFO networking_nsxv3.common.synchronization [None req-8ad683b8-3d55-4ed8-8d6d-430777d19e01 tempest-VolumesAdminNegativeTest-2021792328 tempest-VolumesAdminNegativeTest-2021792328-project-member] Enqueued Resource ID: 025fa550-df80-4c1b-a8f7-f75221e3bef7 with Priority: HIGHEST for action security_group_rules [ 1007.895944] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 025fa550-df80-4c1b-a8f7-f75221e3bef7 with Priority: HIGHEST for action security_group_rules [ 1007.895944] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-025fa550-df80-4c1b-a8f7-f75221e3bef7 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.895944] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-025fa550-df80-4c1b-a8f7-f75221e3bef7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.215154] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.215446] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.215686] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.215882] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.216050] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.216324] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 191e2435-97b6-4df4-bf52-8ed36a5df066 not found, creating... [ 1008.216539] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.216790] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.216903] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.217176] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.217281] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.217949] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.217949] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.217949] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.218140] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.218312] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.218552] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 191e2435-97b6-4df4-bf52-8ed36a5df066 is going to be created. [ 1008.241822] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.242221] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.242446] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.243299] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.243554] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.243792] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-191e2435-97b6-4df4-bf52-8ed36a5df066" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.344900] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.346498] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.346498] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.346498] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.346662] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.346662] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 025fa550-df80-4c1b-a8f7-f75221e3bef7 already deleted. [ 1008.347125] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-025fa550-df80-4c1b-a8f7-f75221e3bef7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.347125] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-025fa550-df80-4c1b-a8f7-f75221e3bef7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.347281] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-025fa550-df80-4c1b-a8f7-f75221e3bef7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.347442] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('025fa550-df80-4c1b-a8f7-f75221e3bef7',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.742490] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 in Status: SUCCESS [ 1008.742717] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.742881] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.743142] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.743360] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.743520] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.743581] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.743693] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.743774] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.743875] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.744023] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9995ac6-c7bb-4911-9b05-92ca94f2c030 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.744119] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.744222] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.744407] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.744557] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.744653] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.744712] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.744852] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.744913] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.744999] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.745147] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a9995ac6-c7bb-4911-9b05-92ca94f2c030',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.746385] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.746385] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.746385] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.746618] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.746618] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.746618] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.746774] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.746774] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9995ac6-c7bb-4911-9b05-92ca94f2c030',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.871837] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.871837] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.871837] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.871837] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.871837] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.871837] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 025fa550-df80-4c1b-a8f7-f75221e3bef7 already deleted. [ 1008.871837] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-025fa550-df80-4c1b-a8f7-f75221e3bef7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.220981] env[70764]: INFO networking_nsxv3.common.synchronization [req-8c6a593a-2991-4321-b76b-f39af3df1cbf req-c7a2b972-fc0d-48ab-b2e2-11c791e0fe80 service nova] Enqueued Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGHEST for action security_group_rules [ 1009.221223] env[70764]: INFO networking_nsxv3.common.synchronization [req-8c6a593a-2991-4321-b76b-f39af3df1cbf req-c7a2b972-fc0d-48ab-b2e2-11c791e0fe80 service nova] Enqueued Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGHEST for action security_group_members [ 1009.221379] env[70764]: INFO networking_nsxv3.common.synchronization [req-8c6a593a-2991-4321-b76b-f39af3df1cbf req-c7a2b972-fc0d-48ab-b2e2-11c791e0fe80 service nova] Enqueued Resource ID: 191e2435-97b6-4df4-bf52-8ed36a5df066 with Priority: HIGHEST for action port [ 1009.221555] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGHEST for action security_group_rules [ 1009.221627] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGHEST for action security_group_members [ 1009.221728] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 191e2435-97b6-4df4-bf52-8ed36a5df066 with Priority: HIGHEST for action port [ 1009.222375] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3379805b-13ae-4057-9511-570e8b3c2437 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.222491] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.222560] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.222753] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.224096] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3379805b-13ae-4057-9511-570e8b3c2437',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.225438] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-3379805b-13ae-4057-9511-570e8b3c2437 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.225438] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.225438] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-191e2435-97b6-4df4-bf52-8ed36a5df066 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.225633] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-191e2435-97b6-4df4-bf52-8ed36a5df066" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.225633] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-191e2435-97b6-4df4-bf52-8ed36a5df066" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.225779] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-191e2435-97b6-4df4-bf52-8ed36a5df066" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.225859] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('191e2435-97b6-4df4-bf52-8ed36a5df066',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.249543] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a9995ac6-c7bb-4911-9b05-92ca94f2c030: rpc.has_security_group_logging(os_id): False [ 1009.249826] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9995ac6-c7bb-4911-9b05-92ca94f2c030',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.269379] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.269379] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.269379] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.269379] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.269379] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.269379] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.269379] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.269379] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.269379] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.269772] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.269772] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.269772] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.269772] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.269899] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.269965] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.270180] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.270298] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.270408] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.270457] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.270533] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.270613] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 is going to be created. [ 1009.315817] env[70764]: INFO networking_nsxv3.common.synchronization [None req-28b328bf-a557-451c-aeb8-496ca7ed6e84 None None] Enqueued Resource ID: 9a885da4-92b7-410a-8732-ec2c49f5d6c0 with Priority: HIGHEST for action port [ 1009.316098] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a885da4-92b7-410a-8732-ec2c49f5d6c0 with Priority: HIGHEST for action port [ 1009.316679] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a885da4-92b7-410a-8732-ec2c49f5d6c0 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.316803] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a885da4-92b7-410a-8732-ec2c49f5d6c0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.317198] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a885da4-92b7-410a-8732-ec2c49f5d6c0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.318329] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a885da4-92b7-410a-8732-ec2c49f5d6c0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.318460] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a885da4-92b7-410a-8732-ec2c49f5d6c0',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.324353] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.324478] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.324522] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.325425] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.325637] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.336965] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 in Status: IN_PROGRESS for 2s [ 1009.728604] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-3379805b-13ae-4057-9511-570e8b3c2437 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.728805] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.730317] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 191e2435-97b6-4df4-bf52-8ed36a5df066 with status ACTIVE [ 1009.730545] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.730777] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.730777] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.730960] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.731076] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.731265] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.731386] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.731430] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.731796] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.731889] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.732154] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.732243] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.732736] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.732736] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.732736] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.732736] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 191e2435-97b6-4df4-bf52-8ed36a5df066 is going to be updated. [ 1009.752417] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9995ac6-c7bb-4911-9b05-92ca94f2c030',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.754283] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.754427] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.754500] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.754701] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.755181] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.755181] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-191e2435-97b6-4df4-bf52-8ed36a5df066" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.820402] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9a885da4-92b7-410a-8732-ec2c49f5d6c0 [ 1009.820402] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.820402] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.820648] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.820648] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.820709] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.820807] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9a885da4-92b7-410a-8732-ec2c49f5d6c0 already deleted. [ 1009.820941] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a885da4-92b7-410a-8732-ec2c49f5d6c0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.826833] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3379805b-13ae-4057-9511-570e8b3c2437 in Status: SUCCESS [ 1009.827022] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3379805b-13ae-4057-9511-570e8b3c2437 deletion is rescheduled due to dependency. [ 1009.827125] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.827595] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.827787] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.827960] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.828095] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.828158] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.828321] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.828494] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.828494] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3379805b-13ae-4057-9511-570e8b3c2437',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.256962] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.256962] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.256962] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.257314] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.257385] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.257455] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 is going to be updated. [ 1010.285165] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.287866] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.287866] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.287866] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.287866] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.295728] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 in Status: IN_PROGRESS for 2s [ 1010.331455] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3379805b-13ae-4057-9511-570e8b3c2437',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.834908] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3379805b-13ae-4057-9511-570e8b3c2437',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.964578] env[70764]: INFO networking_nsxv3.common.synchronization [req-acdcaa66-641b-4752-b351-f0743e2bcc6c req-0a25ea93-a4b5-4b6e-8f4c-65a421a07234 tempest-ListServersNegativeTestJSON-1304984611 tempest-ListServersNegativeTestJSON-1304984611-project-member] Enqueued Resource ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 with Priority: HIGHEST for action security_group_members [ 1010.965242] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 with Priority: HIGHEST for action security_group_members [ 1010.966114] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9995ac6-c7bb-4911-9b05-92ca94f2c030 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.966259] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.336480] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.336838] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.336838] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.337080] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.337080] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.337263] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3379805b-13ae-4057-9511-570e8b3c2437 is going to be updated. [ 1011.351352] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 in Status: SUCCESS [ 1011.351568] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.351732] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.351940] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.352058] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9995ac6-c7bb-4911-9b05-92ca94f2c030',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.365362] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.365362] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.365362] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.365778] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.365778] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.373421] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3379805b-13ae-4057-9511-570e8b3c2437 in Status: IN_PROGRESS for 2s [ 1011.854507] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9995ac6-c7bb-4911-9b05-92ca94f2c030 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.854507] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.304445] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 in Status: SUCCESS [ 1012.304678] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.304867] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.305813] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.305813] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.305813] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.305813] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.305813] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.305813] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.305813] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9995ac6-c7bb-4911-9b05-92ca94f2c030',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.808215] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9995ac6-c7bb-4911-9b05-92ca94f2c030',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.310721] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9995ac6-c7bb-4911-9b05-92ca94f2c030',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.384094] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3379805b-13ae-4057-9511-570e8b3c2437 in Status: SUCCESS [ 1013.384094] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.384094] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.384094] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.384336] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.384423] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.385166] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.385166] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.386311] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.386311] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.386564] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3379805b-13ae-4057-9511-570e8b3c2437',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.813377] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.813638] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.813727] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.814019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.814124] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.814238] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 is going to be updated. [ 1013.839176] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.839324] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.839363] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.839951] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.840096] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.849593] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 in Status: IN_PROGRESS for 2s [ 1013.891283] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-3379805b-13ae-4057-9511-570e8b3c2437 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.891441] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.891985] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.891985] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.891985] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.891985] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.892978] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.892978] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.894025] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.894025] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.894178] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-3379805b-13ae-4057-9511-570e8b3c2437 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.894178] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.894290] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.894352] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.894713] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.894713] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.894713] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.894917] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.894917] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.894917] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.895071] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3379805b-13ae-4057-9511-570e8b3c2437',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.397321] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3379805b-13ae-4057-9511-570e8b3c2437: rpc.has_security_group_logging(os_id): False [ 1014.414966] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.415149] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.415149] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.415357] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.415451] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.415672] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.415776] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.415842] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.415993] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.416090] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.416266] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.416360] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.416421] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.416558] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.416630] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.416812] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.416905] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.416967] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.417202] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.417202] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.417311] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3379805b-13ae-4057-9511-570e8b3c2437 is going to be updated. [ 1014.473430] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.473635] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.473635] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.473982] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.474220] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.486308] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3379805b-13ae-4057-9511-570e8b3c2437 in Status: IN_PROGRESS for 2s [ 1015.174658] env[70764]: INFO networking_nsxv3.common.synchronization [req-ede8ce21-2456-4110-bdb5-7708b228365e req-892b837b-4be4-44a2-a886-0d0b62856b0e tempest-FloatingIPsAssociationTestJSON-699796548 tempest-FloatingIPsAssociationTestJSON-699796548-project-member] Enqueued Resource ID: 390854ae-4528-43fa-8fd3-61a4742be55a with Priority: HIGHEST for action security_group_members [ 1015.174658] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 390854ae-4528-43fa-8fd3-61a4742be55a with Priority: HIGHEST for action security_group_members [ 1015.174658] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-390854ae-4528-43fa-8fd3-61a4742be55a taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.174658] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.174658] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.174658] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.174658] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.174658] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.174658] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.175542] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.175542] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.175542] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('390854ae-4528-43fa-8fd3-61a4742be55a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.479071] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-291 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.479071] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-291" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.479265] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-291" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.479518] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-291" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.479801] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.479973] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.480100] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.480321] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.480467] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.480678] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1015.480792] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1015.480902] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1015.481018] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1015.481157] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1015.481297] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1015.481436] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1015.498459] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1015.499377] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1015.499377] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1015.499377] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-291" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.499377] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-3b2f2262-f577-4767-b874-4d74da9452f8 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.499377] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-3b2f2262-f577-4767-b874-4d74da9452f8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.499652] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-3b2f2262-f577-4767-b874-4d74da9452f8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.499860] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-3b2f2262-f577-4767-b874-4d74da9452f8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.500199] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b2f2262-f577-4767-b874-4d74da9452f8',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.677191] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.677365] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.677436] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.677678] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.677835] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.678023] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.678109] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.678950] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.678950] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.678950] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.678950] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 390854ae-4528-43fa-8fd3-61a4742be55a already deleted. [ 1015.678950] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.862736] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 in Status: SUCCESS [ 1015.862951] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.863148] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.863383] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.863577] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.863693] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.863759] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.863906] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.863986] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.864114] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.864164] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a9995ac6-c7bb-4911-9b05-92ca94f2c030',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.002342] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.002585] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.002795] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.003012] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.003175] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.003350] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 3b2f2262-f577-4767-b874-4d74da9452f8 not found, creating... [ 1016.003620] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.003786] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.003903] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.004142] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.004285] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.004570] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.004755] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.004867] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.005051] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.005191] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.005338] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 3b2f2262-f577-4767-b874-4d74da9452f8 is going to be created. [ 1016.023067] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.023298] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.023433] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.023778] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.023880] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.024117] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-3b2f2262-f577-4767-b874-4d74da9452f8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.366489] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9995ac6-c7bb-4911-9b05-92ca94f2c030 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.366856] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.366856] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.366950] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.367129] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.367242] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.367280] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.368025] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.368025] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.368025] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.368025] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9995ac6-c7bb-4911-9b05-92ca94f2c030 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.368025] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.368025] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.368025] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.368321] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.368321] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.368321] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.368421] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.368460] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.368545] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.368631] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a9995ac6-c7bb-4911-9b05-92ca94f2c030',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.499352] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3379805b-13ae-4057-9511-570e8b3c2437 in Status: SUCCESS [ 1016.499529] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.731386] env[70764]: INFO networking_nsxv3.common.synchronization [req-ede8ce21-2456-4110-bdb5-7708b228365e req-e204b19c-1b72-42d2-b267-24a38cb6c5a9 service nova] Enqueued Resource ID: 390854ae-4528-43fa-8fd3-61a4742be55a with Priority: HIGHEST for action security_group_rules [ 1016.731386] env[70764]: INFO networking_nsxv3.common.synchronization [req-ede8ce21-2456-4110-bdb5-7708b228365e req-e204b19c-1b72-42d2-b267-24a38cb6c5a9 service nova] Enqueued Resource ID: 390854ae-4528-43fa-8fd3-61a4742be55a with Priority: HIGHEST for action security_group_members [ 1016.731386] env[70764]: INFO networking_nsxv3.common.synchronization [req-ede8ce21-2456-4110-bdb5-7708b228365e req-e204b19c-1b72-42d2-b267-24a38cb6c5a9 service nova] Enqueued Resource ID: 3b2f2262-f577-4767-b874-4d74da9452f8 with Priority: HIGHEST for action port [ 1016.731386] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 390854ae-4528-43fa-8fd3-61a4742be55a with Priority: HIGHEST for action security_group_rules [ 1016.731386] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 390854ae-4528-43fa-8fd3-61a4742be55a with Priority: HIGHEST for action security_group_members [ 1016.731386] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b2f2262-f577-4767-b874-4d74da9452f8 with Priority: HIGHEST for action port [ 1016.731386] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-390854ae-4528-43fa-8fd3-61a4742be55a taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.731386] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.731386] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.731386] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.731850] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('390854ae-4528-43fa-8fd3-61a4742be55a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.732745] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-390854ae-4528-43fa-8fd3-61a4742be55a taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.732839] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.732877] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.736140] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.736140] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.736140] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.736140] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.736140] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.736140] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.736140] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('390854ae-4528-43fa-8fd3-61a4742be55a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.736140] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b2f2262-f577-4767-b874-4d74da9452f8 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.736140] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b2f2262-f577-4767-b874-4d74da9452f8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.736140] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b2f2262-f577-4767-b874-4d74da9452f8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.736140] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b2f2262-f577-4767-b874-4d74da9452f8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.736140] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b2f2262-f577-4767-b874-4d74da9452f8',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.871171] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a9995ac6-c7bb-4911-9b05-92ca94f2c030: rpc.has_security_group_logging(os_id): False [ 1016.889335] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.889335] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.889335] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.889335] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.889335] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.889572] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.889572] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.889647] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.889785] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.889863] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.890074] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.890195] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.890260] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.890597] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.890597] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.890720] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.890775] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.890834] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.890976] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.891063] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.891150] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 is going to be updated. [ 1016.948026] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.948196] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.948267] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.948491] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.948636] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.960217] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 in Status: IN_PROGRESS for 2s [ 1017.234025] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-390854ae-4528-43fa-8fd3-61a4742be55a taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.234179] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.235525] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('390854ae-4528-43fa-8fd3-61a4742be55a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.239656] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3b2f2262-f577-4767-b874-4d74da9452f8 with status ACTIVE [ 1017.239656] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.239656] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.239656] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.239656] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.239656] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.239656] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.239656] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.239656] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.239656] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.239656] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.239656] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.239656] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.239656] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.239656] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.239656] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.239656] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3b2f2262-f577-4767-b874-4d74da9452f8 is going to be updated. [ 1017.259524] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.259690] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.259731] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.259953] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.260169] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.260373] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b2f2262-f577-4767-b874-4d74da9452f8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.737625] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('390854ae-4528-43fa-8fd3-61a4742be55a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.239706] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.239869] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.242962] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.242962] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.242962] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.242962] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 390854ae-4528-43fa-8fd3-61a4742be55a is going to be created. [ 1018.262191] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.262326] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.262391] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.262641] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.262812] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.271797] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 390854ae-4528-43fa-8fd3-61a4742be55a in Status: UNINITIALIZED for 2s [ 1018.972643] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 in Status: SUCCESS [ 1018.972942] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.973137] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.973375] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.973474] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9995ac6-c7bb-4911-9b05-92ca94f2c030',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.475585] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9995ac6-c7bb-4911-9b05-92ca94f2c030 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.475803] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.480021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.480021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.480021] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.480021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.480021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.480021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.480286] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.480286] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.480356] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a9995ac6-c7bb-4911-9b05-92ca94f2c030',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.875335] env[70764]: INFO networking_nsxv3.common.synchronization [None req-56b626d0-6105-4b65-b8c4-022dc26a7dfc tempest-AttachVolumeShelveTestJSON-384280106 tempest-AttachVolumeShelveTestJSON-384280106-project-member] Enqueued Resource ID: 4e505537-e930-46b3-bee1-b6cba5260d3d with Priority: HIGHEST for action security_group_rules [ 1019.875335] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e505537-e930-46b3-bee1-b6cba5260d3d with Priority: HIGHEST for action security_group_rules [ 1019.875335] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e505537-e930-46b3-bee1-b6cba5260d3d taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.875335] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.875335] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.875586] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.875586] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e505537-e930-46b3-bee1-b6cba5260d3d',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.958900] env[70764]: INFO networking_nsxv3.common.synchronization [None req-b8dce6b7-4a0c-47fb-a20b-4b87be751737 tempest-AttachVolumeShelveTestJSON-384280106 tempest-AttachVolumeShelveTestJSON-384280106-project-member] Enqueued Resource ID: 4e505537-e930-46b3-bee1-b6cba5260d3d with Priority: HIGHEST for action security_group_rules [ 1019.961791] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e505537-e930-46b3-bee1-b6cba5260d3d with Priority: HIGHEST for action security_group_rules [ 1019.961791] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e505537-e930-46b3-bee1-b6cba5260d3d taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.961791] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.984311] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9995ac6-c7bb-4911-9b05-92ca94f2c030 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.984648] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.984648] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.984865] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.986126] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.986256] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.986334] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.987018] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.987018] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.987018] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.987018] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9995ac6-c7bb-4911-9b05-92ca94f2c030 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.987018] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.987018] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.987301] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.987301] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.987376] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.987409] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.987648] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.987648] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.987711] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.987750] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a9995ac6-c7bb-4911-9b05-92ca94f2c030',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.282644] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 390854ae-4528-43fa-8fd3-61a4742be55a in Status: SUCCESS [ 1020.282822] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.282983] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.283251] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.283432] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.283553] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.283661] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.283768] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.283848] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.283932] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.284033] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('390854ae-4528-43fa-8fd3-61a4742be55a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.395756] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.395935] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.396010] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.396245] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.396337] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.396435] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e505537-e930-46b3-bee1-b6cba5260d3d already deleted. [ 1020.396521] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.396665] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.396817] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.396899] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e505537-e930-46b3-bee1-b6cba5260d3d',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.492507] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a9995ac6-c7bb-4911-9b05-92ca94f2c030: rpc.has_security_group_logging(os_id): False [ 1020.510772] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.511080] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.511393] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.511668] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.511809] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.512033] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.512279] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.512364] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.512554] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.512642] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.512861] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.512967] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.513070] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.513238] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.513322] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.513533] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.513630] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.513692] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.513835] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.513910] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.513995] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 is going to be updated. [ 1020.572252] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.572333] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.573050] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.573050] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.573050] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.586220] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 in Status: IN_PROGRESS for 2s [ 1020.786176] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-390854ae-4528-43fa-8fd3-61a4742be55a taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.788970] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.788970] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.788970] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.788970] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.788970] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.788970] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.788970] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.788970] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.788970] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.788970] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-390854ae-4528-43fa-8fd3-61a4742be55a taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.788970] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.788970] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.788970] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.788970] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.788970] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.788970] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.788970] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.788970] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.789611] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.789611] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('390854ae-4528-43fa-8fd3-61a4742be55a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.915633] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.915896] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.915946] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.916303] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.916497] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.916654] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e505537-e930-46b3-bee1-b6cba5260d3d already deleted. [ 1020.916789] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.291458] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 390854ae-4528-43fa-8fd3-61a4742be55a: rpc.has_security_group_logging(os_id): False [ 1021.310300] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.310300] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.312279] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.312279] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.312279] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.312506] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.312617] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.312679] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.312836] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.312909] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.313135] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.313245] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.314103] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.314103] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.314103] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.315099] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.315264] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.315331] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.315479] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.315558] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.315651] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 390854ae-4528-43fa-8fd3-61a4742be55a is going to be created. [ 1021.370529] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.370529] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.370529] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.370529] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.370717] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.380796] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 390854ae-4528-43fa-8fd3-61a4742be55a in Status: IN_PROGRESS for 2s [ 1022.055815] env[70764]: INFO networking_nsxv3.common.synchronization [None req-4f9320f6-5cc4-496c-865d-dcbe2829c5ab tempest-ServerActionsTestJSON-288318646 tempest-ServerActionsTestJSON-288318646-project-member] Enqueued Resource ID: 10a6cc00-1953-4c0f-8a12-c0405294ba0f with Priority: HIGHEST for action security_group_rules [ 1022.056281] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10a6cc00-1953-4c0f-8a12-c0405294ba0f with Priority: HIGHEST for action security_group_rules [ 1022.056577] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-10a6cc00-1953-4c0f-8a12-c0405294ba0f taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.056880] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-10a6cc00-1953-4c0f-8a12-c0405294ba0f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.056880] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-10a6cc00-1953-4c0f-8a12-c0405294ba0f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.057021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-10a6cc00-1953-4c0f-8a12-c0405294ba0f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.057123] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('10a6cc00-1953-4c0f-8a12-c0405294ba0f',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.131168] env[70764]: INFO networking_nsxv3.common.synchronization [None req-0c762248-0481-4107-b343-88972254b4a9 tempest-ServerActionsTestJSON-288318646 tempest-ServerActionsTestJSON-288318646-project-member] Enqueued Resource ID: 10a6cc00-1953-4c0f-8a12-c0405294ba0f with Priority: HIGHEST for action security_group_rules [ 1022.131168] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10a6cc00-1953-4c0f-8a12-c0405294ba0f with Priority: HIGHEST for action security_group_rules [ 1022.131168] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-10a6cc00-1953-4c0f-8a12-c0405294ba0f taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.131168] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-10a6cc00-1953-4c0f-8a12-c0405294ba0f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.578078] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.578078] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.578078] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.578078] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.578078] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.578078] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 10a6cc00-1953-4c0f-8a12-c0405294ba0f already deleted. [ 1022.578078] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-10a6cc00-1953-4c0f-8a12-c0405294ba0f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.578078] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-10a6cc00-1953-4c0f-8a12-c0405294ba0f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.578838] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-10a6cc00-1953-4c0f-8a12-c0405294ba0f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.578838] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('10a6cc00-1953-4c0f-8a12-c0405294ba0f',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.600268] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 in Status: SUCCESS [ 1022.600581] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.105149] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.105149] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.105340] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.106383] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.106383] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.106383] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 10a6cc00-1953-4c0f-8a12-c0405294ba0f already deleted. [ 1023.106383] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-10a6cc00-1953-4c0f-8a12-c0405294ba0f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.393810] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 390854ae-4528-43fa-8fd3-61a4742be55a in Status: SUCCESS [ 1023.393810] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.131309] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1027.131593] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1027.609264] env[70764]: INFO networking_nsxv3.common.synchronization [req-f8d174da-53d0-472d-9f79-872af9ba450c req-a0198d2d-a1a6-46b1-8862-e2b366d66190 tempest-ImagesTestJSON-1647743380 tempest-ImagesTestJSON-1647743380-project-member] Enqueued Resource ID: 4580d502-1d18-4681-96a4-28ac4e291d69 with Priority: HIGHEST for action security_group_members [ 1027.610035] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4580d502-1d18-4681-96a4-28ac4e291d69 with Priority: HIGHEST for action security_group_members [ 1027.611281] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4580d502-1d18-4681-96a4-28ac4e291d69 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.611281] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.611281] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.611281] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.611281] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.611281] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.611281] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.611281] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.611281] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.611281] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4580d502-1d18-4681-96a4-28ac4e291d69',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.949123] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-828 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.949425] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-828" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.949543] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-828" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.949814] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-828" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.950083] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.950307] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.950439] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.950659] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.950841] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.951066] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1027.951190] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1027.951303] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1027.951418] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1027.951534] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1027.951687] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1027.951829] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1027.970716] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1027.970925] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1027.971108] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1027.971296] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-828" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.971608] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-7e0fcbb0-bec6-42cc-9c47-d619af0b65a5 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.971820] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-7e0fcbb0-bec6-42cc-9c47-d619af0b65a5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.971952] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-7e0fcbb0-bec6-42cc-9c47-d619af0b65a5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.972318] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-7e0fcbb0-bec6-42cc-9c47-d619af0b65a5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.972491] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e0fcbb0-bec6-42cc-9c47-d619af0b65a5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.113385] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.113593] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.113666] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.113842] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.113962] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.114168] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.114282] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.114362] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.114459] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.114546] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.114636] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4580d502-1d18-4681-96a4-28ac4e291d69 is going to be updated. [ 1028.138546] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.138894] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.138894] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.139027] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.139175] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.147075] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4580d502-1d18-4681-96a4-28ac4e291d69 in Status: IN_PROGRESS for 2s [ 1028.392115] env[70764]: INFO networking_nsxv3.common.synchronization [req-f0c86997-293a-4752-b15b-b06bab3c34cf req-80f05e60-226f-4ca3-a5b4-8988e86913b7 tempest-ServerRescueNegativeTestJSON-1208111124 tempest-ServerRescueNegativeTestJSON-1208111124-project-member] Enqueued Resource ID: 1f7d8ca5-61df-4ea2-b964-843e08d1b082 with Priority: HIGHEST for action security_group_members [ 1028.393148] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f7d8ca5-61df-4ea2-b964-843e08d1b082 with Priority: HIGHEST for action security_group_members [ 1028.395280] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f7d8ca5-61df-4ea2-b964-843e08d1b082 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.395520] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.395611] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.395852] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.396054] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.396189] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.396273] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.396465] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.397452] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.397595] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f7d8ca5-61df-4ea2-b964-843e08d1b082',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.475310] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.475540] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.475640] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.475904] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.476077] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.476238] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 7e0fcbb0-bec6-42cc-9c47-d619af0b65a5 not found, creating... [ 1028.476504] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.476666] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.476784] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.477016] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.477159] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.477448] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.477598] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.477717] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.477926] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.478280] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.478460] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 7e0fcbb0-bec6-42cc-9c47-d619af0b65a5 is going to be created. [ 1028.496902] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.497196] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.497270] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.497548] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.497782] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.498015] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-7e0fcbb0-bec6-42cc-9c47-d619af0b65a5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.900031] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f7d8ca5-61df-4ea2-b964-843e08d1b082',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.196389] env[70764]: INFO networking_nsxv3.common.synchronization [req-f8d174da-53d0-472d-9f79-872af9ba450c req-07115794-8a28-4967-8ea4-2f679e0fac76 service nova] Enqueued Resource ID: 4580d502-1d18-4681-96a4-28ac4e291d69 with Priority: HIGHEST for action security_group_rules [ 1029.196389] env[70764]: INFO networking_nsxv3.common.synchronization [req-f8d174da-53d0-472d-9f79-872af9ba450c req-07115794-8a28-4967-8ea4-2f679e0fac76 service nova] Enqueued Resource ID: 4580d502-1d18-4681-96a4-28ac4e291d69 with Priority: HIGHEST for action security_group_members [ 1029.196389] env[70764]: INFO networking_nsxv3.common.synchronization [req-f8d174da-53d0-472d-9f79-872af9ba450c req-07115794-8a28-4967-8ea4-2f679e0fac76 service nova] Enqueued Resource ID: 7e0fcbb0-bec6-42cc-9c47-d619af0b65a5 with Priority: HIGHEST for action port [ 1029.196389] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4580d502-1d18-4681-96a4-28ac4e291d69 with Priority: HIGHEST for action security_group_rules [ 1029.196389] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4580d502-1d18-4681-96a4-28ac4e291d69 with Priority: HIGHEST for action security_group_members [ 1029.196389] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e0fcbb0-bec6-42cc-9c47-d619af0b65a5 with Priority: HIGHEST for action port [ 1029.196853] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4580d502-1d18-4681-96a4-28ac4e291d69 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.196987] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.196987] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.197940] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.197940] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4580d502-1d18-4681-96a4-28ac4e291d69',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.199293] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4580d502-1d18-4681-96a4-28ac4e291d69 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.199427] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.199873] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e0fcbb0-bec6-42cc-9c47-d619af0b65a5 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.199995] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e0fcbb0-bec6-42cc-9c47-d619af0b65a5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.200072] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e0fcbb0-bec6-42cc-9c47-d619af0b65a5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.200269] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e0fcbb0-bec6-42cc-9c47-d619af0b65a5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.200488] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e0fcbb0-bec6-42cc-9c47-d619af0b65a5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.401721] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f7d8ca5-61df-4ea2-b964-843e08d1b082',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.705965] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7e0fcbb0-bec6-42cc-9c47-d619af0b65a5 with status ACTIVE [ 1029.706233] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.706377] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.706449] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.706659] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.706807] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.707165] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.707165] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.707165] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.707320] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.707320] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.707453] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.707547] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.707603] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.707740] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.707807] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.707890] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7e0fcbb0-bec6-42cc-9c47-d619af0b65a5 is going to be updated. [ 1029.710155] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4580d502-1d18-4681-96a4-28ac4e291d69 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.710330] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.730562] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.730713] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.730781] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.731031] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.731267] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.731450] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e0fcbb0-bec6-42cc-9c47-d619af0b65a5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.905889] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.905889] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.905889] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.905889] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.905889] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.905889] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f7d8ca5-61df-4ea2-b964-843e08d1b082 is going to be updated. [ 1029.935018] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.935198] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.935239] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.935452] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.935596] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.945025] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f7d8ca5-61df-4ea2-b964-843e08d1b082 in Status: IN_PROGRESS for 2s [ 1030.155183] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4580d502-1d18-4681-96a4-28ac4e291d69 in Status: SUCCESS [ 1030.155344] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4580d502-1d18-4681-96a4-28ac4e291d69 deletion is rescheduled due to dependency. [ 1030.155461] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.156196] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.156196] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.156196] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.156196] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.156196] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.156595] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.156595] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.156595] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4580d502-1d18-4681-96a4-28ac4e291d69',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.661898] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4580d502-1d18-4681-96a4-28ac4e291d69',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.164677] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4580d502-1d18-4681-96a4-28ac4e291d69',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.670132] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.670132] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.670132] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.670132] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.670132] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.670132] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4580d502-1d18-4681-96a4-28ac4e291d69 is going to be updated. [ 1031.695759] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.695999] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.696149] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.696460] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.696623] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.704946] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4580d502-1d18-4681-96a4-28ac4e291d69 in Status: IN_PROGRESS for 2s [ 1031.956490] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f7d8ca5-61df-4ea2-b964-843e08d1b082 in Status: SUCCESS [ 1031.956490] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.714827] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4580d502-1d18-4681-96a4-28ac4e291d69 in Status: SUCCESS [ 1033.714827] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.715370] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.715370] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.715433] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.715532] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.715588] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.715761] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.715843] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.715932] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.716034] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4580d502-1d18-4681-96a4-28ac4e291d69',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.876495] env[70764]: INFO networking_nsxv3.common.synchronization [req-48b44672-e241-470f-be57-b621e9d71627 req-eb6551cf-86f0-4fd6-a706-1ab6167248e7 tempest-AttachVolumeTestJSON-503324066 tempest-AttachVolumeTestJSON-503324066-project-member] Enqueued Resource ID: 46c016e6-244a-4247-9a9f-a7b0e21f0989 with Priority: HIGHEST for action security_group_members [ 1033.877030] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46c016e6-244a-4247-9a9f-a7b0e21f0989 with Priority: HIGHEST for action security_group_members [ 1033.877319] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-46c016e6-244a-4247-9a9f-a7b0e21f0989 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.877440] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46c016e6-244a-4247-9a9f-a7b0e21f0989" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.877505] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46c016e6-244a-4247-9a9f-a7b0e21f0989" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.877755] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46c016e6-244a-4247-9a9f-a7b0e21f0989" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.878439] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.878439] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.878439] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.878439] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.878439] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.878439] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46c016e6-244a-4247-9a9f-a7b0e21f0989',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.174100] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-680 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.174273] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-680" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.174418] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-680" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.174714] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-680" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.175017] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.175317] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.175444] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.175670] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.176029] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.176029] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1034.176169] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1034.176251] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1034.176373] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1034.176492] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1034.176604] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1034.176741] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1034.194863] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1034.195039] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1034.195181] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1034.195621] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-680" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.195724] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-d506616a-0f29-4c61-a311-e82742563f4a taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.195886] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-d506616a-0f29-4c61-a311-e82742563f4a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.196033] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-d506616a-0f29-4c61-a311-e82742563f4a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.196318] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-d506616a-0f29-4c61-a311-e82742563f4a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.196460] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d506616a-0f29-4c61-a311-e82742563f4a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.218387] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4580d502-1d18-4681-96a4-28ac4e291d69 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.218532] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.218635] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.218807] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.218982] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.219103] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.219169] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.219301] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.219394] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.219489] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.219645] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4580d502-1d18-4681-96a4-28ac4e291d69 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.219740] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.219855] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.219931] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.220100] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.220209] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.220269] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.220424] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.220500] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.220652] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.220699] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4580d502-1d18-4681-96a4-28ac4e291d69',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.381035] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.381035] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.381035] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.381246] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.381333] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.381537] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.381667] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.381705] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.381854] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.381930] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.382036] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46c016e6-244a-4247-9a9f-a7b0e21f0989 already deleted. [ 1034.382103] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46c016e6-244a-4247-9a9f-a7b0e21f0989" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.699214] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.699452] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.699584] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.699926] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.700035] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.700171] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port d506616a-0f29-4c61-a311-e82742563f4a not found, creating... [ 1034.700647] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.700647] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.700815] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.700960] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.701113] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.701397] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.701556] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.701677] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.701988] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.702190] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.702525] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: d506616a-0f29-4c61-a311-e82742563f4a is going to be created. [ 1034.721733] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.722123] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.722123] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.722311] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.723451] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.723710] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-d506616a-0f29-4c61-a311-e82742563f4a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.725420] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4580d502-1d18-4681-96a4-28ac4e291d69: rpc.has_security_group_logging(os_id): False [ 1034.744146] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.744284] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.744354] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.744533] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.744620] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.744839] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.744939] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.745014] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.745173] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.745251] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.745427] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.745630] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.745630] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.745745] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.745785] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.745948] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.746050] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.746112] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.746249] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.746322] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.746406] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4580d502-1d18-4681-96a4-28ac4e291d69 is going to be updated. [ 1034.815134] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.815290] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.815362] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.815542] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.815680] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.828566] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4580d502-1d18-4681-96a4-28ac4e291d69 in Status: IN_PROGRESS for 2s [ 1035.419318] env[70764]: INFO networking_nsxv3.common.synchronization [req-48b44672-e241-470f-be57-b621e9d71627 req-357a4b9a-bca2-4bb9-92eb-29d2c5c0dba0 service nova] Enqueued Resource ID: 46c016e6-244a-4247-9a9f-a7b0e21f0989 with Priority: HIGHEST for action security_group_rules [ 1035.419318] env[70764]: INFO networking_nsxv3.common.synchronization [req-48b44672-e241-470f-be57-b621e9d71627 req-357a4b9a-bca2-4bb9-92eb-29d2c5c0dba0 service nova] Enqueued Resource ID: 46c016e6-244a-4247-9a9f-a7b0e21f0989 with Priority: HIGHEST for action security_group_members [ 1035.419318] env[70764]: INFO networking_nsxv3.common.synchronization [req-48b44672-e241-470f-be57-b621e9d71627 req-357a4b9a-bca2-4bb9-92eb-29d2c5c0dba0 service nova] Enqueued Resource ID: d506616a-0f29-4c61-a311-e82742563f4a with Priority: HIGHEST for action port [ 1035.419318] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46c016e6-244a-4247-9a9f-a7b0e21f0989 with Priority: HIGHEST for action security_group_rules [ 1035.419318] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46c016e6-244a-4247-9a9f-a7b0e21f0989 with Priority: HIGHEST for action security_group_members [ 1035.419318] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d506616a-0f29-4c61-a311-e82742563f4a with Priority: HIGHEST for action port [ 1035.419820] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46c016e6-244a-4247-9a9f-a7b0e21f0989 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.420205] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46c016e6-244a-4247-9a9f-a7b0e21f0989" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.420390] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46c016e6-244a-4247-9a9f-a7b0e21f0989" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.420699] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46c016e6-244a-4247-9a9f-a7b0e21f0989" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.420908] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46c016e6-244a-4247-9a9f-a7b0e21f0989',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.422757] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-46c016e6-244a-4247-9a9f-a7b0e21f0989 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.423377] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46c016e6-244a-4247-9a9f-a7b0e21f0989" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.423377] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46c016e6-244a-4247-9a9f-a7b0e21f0989" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.423377] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46c016e6-244a-4247-9a9f-a7b0e21f0989" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.423697] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.423923] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.424970] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.424970] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.424970] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.424970] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46c016e6-244a-4247-9a9f-a7b0e21f0989',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.425862] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-d506616a-0f29-4c61-a311-e82742563f4a taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.425862] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d506616a-0f29-4c61-a311-e82742563f4a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.425862] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d506616a-0f29-4c61-a311-e82742563f4a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.426795] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d506616a-0f29-4c61-a311-e82742563f4a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.426795] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d506616a-0f29-4c61-a311-e82742563f4a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.928521] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-46c016e6-244a-4247-9a9f-a7b0e21f0989 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.928521] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46c016e6-244a-4247-9a9f-a7b0e21f0989" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.928855] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('46c016e6-244a-4247-9a9f-a7b0e21f0989',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.929535] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d506616a-0f29-4c61-a311-e82742563f4a with status ACTIVE [ 1035.929630] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.929777] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.931089] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.931089] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.931089] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.931089] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.931089] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.931089] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.931089] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.931089] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.931089] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.931089] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.931089] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.931543] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.931543] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.931543] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d506616a-0f29-4c61-a311-e82742563f4a is going to be updated. [ 1035.954658] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.954824] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.954878] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.955069] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.955199] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.955356] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d506616a-0f29-4c61-a311-e82742563f4a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.433364] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('46c016e6-244a-4247-9a9f-a7b0e21f0989',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.846627] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4580d502-1d18-4681-96a4-28ac4e291d69 in Status: SUCCESS [ 1036.846627] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.936411] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.936761] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.936761] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.936761] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.936861] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.937016] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46c016e6-244a-4247-9a9f-a7b0e21f0989 is going to be created. [ 1036.962127] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.962329] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.962419] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.962612] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.962800] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.970863] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46c016e6-244a-4247-9a9f-a7b0e21f0989 in Status: UNINITIALIZED for 2s [ 1038.980846] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46c016e6-244a-4247-9a9f-a7b0e21f0989 in Status: SUCCESS [ 1038.981154] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46c016e6-244a-4247-9a9f-a7b0e21f0989" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.982013] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46c016e6-244a-4247-9a9f-a7b0e21f0989" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.982013] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46c016e6-244a-4247-9a9f-a7b0e21f0989" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.982013] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.982013] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.982013] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.982013] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.982298] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.982298] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46c016e6-244a-4247-9a9f-a7b0e21f0989" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.982298] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('46c016e6-244a-4247-9a9f-a7b0e21f0989',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.484957] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('46c016e6-244a-4247-9a9f-a7b0e21f0989',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.987104] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 46c016e6-244a-4247-9a9f-a7b0e21f0989: rpc.has_security_group_logging(os_id): False [ 1040.005952] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.006336] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.006413] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.006625] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.006821] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.006967] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.007079] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.007143] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.007296] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.007372] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.007460] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46c016e6-244a-4247-9a9f-a7b0e21f0989 is going to be created. [ 1040.072809] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.073049] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.073049] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.073291] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.073483] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.085130] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46c016e6-244a-4247-9a9f-a7b0e21f0989 in Status: IN_PROGRESS for 2s [ 1040.420057] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1040.420180] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1041.780408] env[70764]: INFO networking_nsxv3.common.synchronization [req-781678e6-cef9-427f-a138-cedfa85fbe44 req-34f2b012-703d-49d5-a730-df9e5cfe9892 tempest-VolumesAdminNegativeTest-2021792328 tempest-VolumesAdminNegativeTest-2021792328-project-member] Enqueued Resource ID: 025fa550-df80-4c1b-a8f7-f75221e3bef7 with Priority: HIGHEST for action security_group_members [ 1041.780408] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 025fa550-df80-4c1b-a8f7-f75221e3bef7 with Priority: HIGHEST for action security_group_members [ 1041.781197] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-025fa550-df80-4c1b-a8f7-f75221e3bef7 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.781197] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-025fa550-df80-4c1b-a8f7-f75221e3bef7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.781197] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-025fa550-df80-4c1b-a8f7-f75221e3bef7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.781197] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-025fa550-df80-4c1b-a8f7-f75221e3bef7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.781438] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.781438] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.781438] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.781574] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.781616] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.781694] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('025fa550-df80-4c1b-a8f7-f75221e3bef7',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.082019] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-663 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.082019] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-663" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.082019] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-663" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.082019] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-663" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.082019] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.082019] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.082019] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.082019] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.082019] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.082019] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1042.082019] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1042.082019] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1042.082019] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1042.082619] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1042.082619] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1042.082619] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1042.095713] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46c016e6-244a-4247-9a9f-a7b0e21f0989 in Status: SUCCESS [ 1042.095921] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46c016e6-244a-4247-9a9f-a7b0e21f0989" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.102999] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1042.103177] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1042.103314] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1042.103489] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-663" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.103804] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-3cb21c94-0800-441d-8f24-88d794f0f0d8 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.103976] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-3cb21c94-0800-441d-8f24-88d794f0f0d8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.104115] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-3cb21c94-0800-441d-8f24-88d794f0f0d8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.104428] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-3cb21c94-0800-441d-8f24-88d794f0f0d8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.104566] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cb21c94-0800-441d-8f24-88d794f0f0d8',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.283283] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.283465] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.283541] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.283785] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.283887] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.284100] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.284203] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.284265] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.284417] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.284527] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.284564] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 025fa550-df80-4c1b-a8f7-f75221e3bef7 already deleted. [ 1042.284645] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-025fa550-df80-4c1b-a8f7-f75221e3bef7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.607146] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.607426] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.607535] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.607820] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.608081] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.608245] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 3cb21c94-0800-441d-8f24-88d794f0f0d8 not found, creating... [ 1042.608510] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.608743] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.608904] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.609213] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.609440] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.609780] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.610013] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.610439] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.610816] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.611226] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.611476] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 3cb21c94-0800-441d-8f24-88d794f0f0d8 is going to be created. [ 1042.641728] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.642065] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.642283] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.642680] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.642992] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.643331] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-3cb21c94-0800-441d-8f24-88d794f0f0d8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.333990] env[70764]: INFO networking_nsxv3.common.synchronization [req-781678e6-cef9-427f-a138-cedfa85fbe44 req-1c47bff8-338a-4eee-ae52-551d240e5ef4 service nova] Enqueued Resource ID: 025fa550-df80-4c1b-a8f7-f75221e3bef7 with Priority: HIGHEST for action security_group_rules [ 1043.334252] env[70764]: INFO networking_nsxv3.common.synchronization [req-781678e6-cef9-427f-a138-cedfa85fbe44 req-1c47bff8-338a-4eee-ae52-551d240e5ef4 service nova] Enqueued Resource ID: 025fa550-df80-4c1b-a8f7-f75221e3bef7 with Priority: HIGHEST for action security_group_members [ 1043.334352] env[70764]: INFO networking_nsxv3.common.synchronization [req-781678e6-cef9-427f-a138-cedfa85fbe44 req-1c47bff8-338a-4eee-ae52-551d240e5ef4 service nova] Enqueued Resource ID: 3cb21c94-0800-441d-8f24-88d794f0f0d8 with Priority: HIGHEST for action port [ 1043.334561] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 025fa550-df80-4c1b-a8f7-f75221e3bef7 with Priority: HIGHEST for action security_group_rules [ 1043.334688] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 025fa550-df80-4c1b-a8f7-f75221e3bef7 with Priority: HIGHEST for action security_group_members [ 1043.334786] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cb21c94-0800-441d-8f24-88d794f0f0d8 with Priority: HIGHEST for action port [ 1043.335895] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-025fa550-df80-4c1b-a8f7-f75221e3bef7 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.335994] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-025fa550-df80-4c1b-a8f7-f75221e3bef7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.336077] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-025fa550-df80-4c1b-a8f7-f75221e3bef7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.336273] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-025fa550-df80-4c1b-a8f7-f75221e3bef7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.336355] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('025fa550-df80-4c1b-a8f7-f75221e3bef7',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.337464] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-025fa550-df80-4c1b-a8f7-f75221e3bef7 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.337464] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-025fa550-df80-4c1b-a8f7-f75221e3bef7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.337464] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-025fa550-df80-4c1b-a8f7-f75221e3bef7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.337464] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-025fa550-df80-4c1b-a8f7-f75221e3bef7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.337667] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.337711] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.337786] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.337891] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.337978] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.338080] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('025fa550-df80-4c1b-a8f7-f75221e3bef7',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.338771] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-3cb21c94-0800-441d-8f24-88d794f0f0d8 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.338878] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3cb21c94-0800-441d-8f24-88d794f0f0d8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.338967] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3cb21c94-0800-441d-8f24-88d794f0f0d8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.339099] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3cb21c94-0800-441d-8f24-88d794f0f0d8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.339168] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cb21c94-0800-441d-8f24-88d794f0f0d8',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.841166] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-025fa550-df80-4c1b-a8f7-f75221e3bef7 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.841356] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-025fa550-df80-4c1b-a8f7-f75221e3bef7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.841483] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('025fa550-df80-4c1b-a8f7-f75221e3bef7',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.842793] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3cb21c94-0800-441d-8f24-88d794f0f0d8 with status ACTIVE [ 1043.842981] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.843123] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.843200] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.843407] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.843498] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.843673] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.843781] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.843838] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.843980] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.844099] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.844412] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.844538] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.844606] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.844757] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.844834] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.844918] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3cb21c94-0800-441d-8f24-88d794f0f0d8 is going to be updated. [ 1043.868236] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.868685] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.868685] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.868685] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.868802] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.868949] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3cb21c94-0800-441d-8f24-88d794f0f0d8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.343276] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('025fa550-df80-4c1b-a8f7-f75221e3bef7',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.845660] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.845887] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.845887] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.846152] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.846248] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.846350] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 025fa550-df80-4c1b-a8f7-f75221e3bef7 is going to be created. [ 1044.870992] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.871148] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.871223] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.871427] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.871581] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.880198] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 025fa550-df80-4c1b-a8f7-f75221e3bef7 in Status: UNINITIALIZED for 2s [ 1045.287674] env[70764]: INFO networking_nsxv3.common.synchronization [req-526fee7d-4e58-4ede-b460-ef268d486233 req-32fdf33b-141a-438c-a3e8-574ea0263cb8 tempest-ListServersNegativeTestJSON-1304984611 tempest-ListServersNegativeTestJSON-1304984611-project-member] Enqueued Resource ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 with Priority: HIGHEST for action security_group_members [ 1045.288788] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 with Priority: HIGHEST for action security_group_members [ 1045.288788] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9995ac6-c7bb-4911-9b05-92ca94f2c030 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.288788] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.288788] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.289045] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.289164] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.289272] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.289336] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.289491] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.289576] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.289678] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9995ac6-c7bb-4911-9b05-92ca94f2c030',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.793983] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9995ac6-c7bb-4911-9b05-92ca94f2c030',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.951526] env[70764]: INFO networking_nsxv3.common.synchronization [req-9525bd2c-61e5-4b8a-aaaf-9ce0f0e3fe6c req-2b88e895-856f-46f4-82b1-173d5946e537 tempest-ListServersNegativeTestJSON-1304984611 tempest-ListServersNegativeTestJSON-1304984611-project-member] Enqueued Resource ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 with Priority: HIGHEST for action security_group_members [ 1045.954989] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 with Priority: HIGHEST for action security_group_members [ 1045.954989] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9995ac6-c7bb-4911-9b05-92ca94f2c030 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.954989] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.017690] env[70764]: INFO networking_nsxv3.common.synchronization [req-09b279a4-5891-4719-a4f5-78cbaff39af6 req-edf58967-b441-497b-a43e-b7c9925f98a1 tempest-AttachVolumeNegativeTest-232785497 tempest-AttachVolumeNegativeTest-232785497-project-member] Enqueued Resource ID: b9410f01-20de-42de-8117-bdf11cf59643 with Priority: HIGHEST for action security_group_members [ 1046.018841] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9410f01-20de-42de-8117-bdf11cf59643 with Priority: HIGHEST for action security_group_members [ 1046.019307] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9410f01-20de-42de-8117-bdf11cf59643 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.019433] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9410f01-20de-42de-8117-bdf11cf59643" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.019500] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9410f01-20de-42de-8117-bdf11cf59643" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.019737] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9410f01-20de-42de-8117-bdf11cf59643" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.020832] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.020978] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.021073] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.021239] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.023519] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.023519] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b9410f01-20de-42de-8117-bdf11cf59643',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.299390] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9995ac6-c7bb-4911-9b05-92ca94f2c030',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.524289] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.524511] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.524580] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.524833] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.525152] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.525257] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.525257] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.525395] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.525502] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.525589] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.525722] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9410f01-20de-42de-8117-bdf11cf59643 is going to be updated. [ 1046.554067] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.554224] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.554302] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.554493] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.554638] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.563860] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9410f01-20de-42de-8117-bdf11cf59643 in Status: IN_PROGRESS for 2s [ 1046.617442] env[70764]: INFO networking_nsxv3.common.synchronization [req-86ee8fc0-fcab-4341-82a2-aaeae36b8e65 req-952e5436-be55-4f06-b904-5d9c3933ca0a tempest-ServersTestJSON-88830314 tempest-ServersTestJSON-88830314-project-member] Enqueued Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_members [ 1046.617823] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_members [ 1046.618628] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.618628] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.618628] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.618628] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.618628] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.618880] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.618880] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.618960] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.618996] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.619325] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.801857] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.802232] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.802232] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.802363] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.802533] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.802533] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 is going to be updated. [ 1046.834404] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.834404] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.834404] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.834404] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.834404] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.840503] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 in Status: IN_PROGRESS for 2s [ 1046.891993] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 025fa550-df80-4c1b-a8f7-f75221e3bef7 in Status: SUCCESS [ 1046.892248] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-025fa550-df80-4c1b-a8f7-f75221e3bef7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.892806] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-025fa550-df80-4c1b-a8f7-f75221e3bef7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.893020] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-025fa550-df80-4c1b-a8f7-f75221e3bef7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.893210] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.893321] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.893381] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.893593] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.893632] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.893711] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-025fa550-df80-4c1b-a8f7-f75221e3bef7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.893795] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('025fa550-df80-4c1b-a8f7-f75221e3bef7',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.014386] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-603 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.014830] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-603" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.014830] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-603" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.015213] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-603" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.015255] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.015409] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.015511] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.015725] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.015935] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.016184] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1047.016893] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1047.016893] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1047.016893] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1047.016893] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1047.016893] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1047.017224] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1047.038201] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1047.038381] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1047.038556] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1047.038742] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-603" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.039073] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-31fbe8c8-a3ef-40f2-8afe-00ee22a8f2ee taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.039258] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-31fbe8c8-a3ef-40f2-8afe-00ee22a8f2ee" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.039371] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-31fbe8c8-a3ef-40f2-8afe-00ee22a8f2ee" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.039684] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-31fbe8c8-a3ef-40f2-8afe-00ee22a8f2ee" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.039828] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31fbe8c8-a3ef-40f2-8afe-00ee22a8f2ee',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.121665] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.399792] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('025fa550-df80-4c1b-a8f7-f75221e3bef7',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.546737] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.547021] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.547155] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.547502] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.547659] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.547817] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 31fbe8c8-a3ef-40f2-8afe-00ee22a8f2ee not found, creating... [ 1047.548156] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.548352] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.548475] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.548731] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.548875] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.549229] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.549396] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.549546] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.549796] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.549967] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.550146] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 31fbe8c8-a3ef-40f2-8afe-00ee22a8f2ee is going to be created. [ 1047.570705] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.571020] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.571135] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.571477] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.571785] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.572152] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-31fbe8c8-a3ef-40f2-8afe-00ee22a8f2ee" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.624312] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.903036] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 025fa550-df80-4c1b-a8f7-f75221e3bef7: rpc.has_security_group_logging(os_id): False [ 1047.941518] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.941725] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.941776] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.941975] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.942150] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.942359] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.942463] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.942518] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.942721] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.942810] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.942912] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 025fa550-df80-4c1b-a8f7-f75221e3bef7 is going to be created. [ 1048.038596] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.038795] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.038795] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.039043] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.039269] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.054100] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 025fa550-df80-4c1b-a8f7-f75221e3bef7 in Status: IN_PROGRESS for 2s [ 1048.127711] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.127921] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.127980] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.128341] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.128452] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.128559] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8f5efec-a14e-4be6-8add-7b35a995c982 is going to be updated. [ 1048.185822] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.186098] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.186098] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.186352] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.186448] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.200284] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: IN_PROGRESS for 2s [ 1048.478306] env[70764]: INFO networking_nsxv3.common.synchronization [req-86ee8fc0-fcab-4341-82a2-aaeae36b8e65 req-4f461c76-e8de-4900-acbf-9d70f27e0f3b service nova] Enqueued Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_rules [ 1048.478479] env[70764]: INFO networking_nsxv3.common.synchronization [req-86ee8fc0-fcab-4341-82a2-aaeae36b8e65 req-4f461c76-e8de-4900-acbf-9d70f27e0f3b service nova] Enqueued Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_members [ 1048.478637] env[70764]: INFO networking_nsxv3.common.synchronization [req-86ee8fc0-fcab-4341-82a2-aaeae36b8e65 req-4f461c76-e8de-4900-acbf-9d70f27e0f3b service nova] Enqueued Resource ID: 31fbe8c8-a3ef-40f2-8afe-00ee22a8f2ee with Priority: HIGHEST for action port [ 1048.478886] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_rules [ 1048.479035] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_members [ 1048.479137] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31fbe8c8-a3ef-40f2-8afe-00ee22a8f2ee with Priority: HIGHEST for action port [ 1048.479693] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.479815] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.479882] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.483661] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.483778] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.485628] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.485628] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.485804] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-31fbe8c8-a3ef-40f2-8afe-00ee22a8f2ee taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.485873] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31fbe8c8-a3ef-40f2-8afe-00ee22a8f2ee" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.486955] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31fbe8c8-a3ef-40f2-8afe-00ee22a8f2ee" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.486955] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31fbe8c8-a3ef-40f2-8afe-00ee22a8f2ee" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.486955] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31fbe8c8-a3ef-40f2-8afe-00ee22a8f2ee',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.573990] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9410f01-20de-42de-8117-bdf11cf59643 in Status: SUCCESS [ 1048.574266] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9410f01-20de-42de-8117-bdf11cf59643 deletion is rescheduled due to dependency. [ 1048.574436] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9410f01-20de-42de-8117-bdf11cf59643" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.850865] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 in Status: SUCCESS [ 1048.851050] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.851207] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.851420] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.851606] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.851724] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.851791] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.851936] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.852022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.852116] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9995ac6-c7bb-4911-9b05-92ca94f2c030',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.988792] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.989584] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.991180] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 31fbe8c8-a3ef-40f2-8afe-00ee22a8f2ee with status ACTIVE [ 1048.991180] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.991467] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.991467] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.991667] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.991667] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.991744] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.991850] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.991887] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.992112] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.992112] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.993048] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.993048] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.993048] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.993048] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.993048] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.993048] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 31fbe8c8-a3ef-40f2-8afe-00ee22a8f2ee is going to be updated. [ 1049.011763] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.011923] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.011923] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.012104] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.012331] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.012383] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31fbe8c8-a3ef-40f2-8afe-00ee22a8f2ee" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.051663] env[70764]: INFO networking_nsxv3.common.synchronization [req-67ccbaac-04ff-4469-9286-bee37f559dfd req-e6df4544-50bc-46fa-9dc7-a76988b0af01 tempest-AttachVolumeShelveTestJSON-384280106 tempest-AttachVolumeShelveTestJSON-384280106-project-member] Enqueued Resource ID: 4e505537-e930-46b3-bee1-b6cba5260d3d with Priority: HIGHEST for action security_group_members [ 1049.052200] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e505537-e930-46b3-bee1-b6cba5260d3d with Priority: HIGHEST for action security_group_members [ 1049.052504] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e505537-e930-46b3-bee1-b6cba5260d3d taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.052666] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.052742] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.052996] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.053294] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.053450] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.053603] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.053775] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.053909] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.054055] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e505537-e930-46b3-bee1-b6cba5260d3d',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.306325] env[70764]: INFO networking_nsxv3.common.synchronization [req-bd94b475-3029-48b9-8301-12e46d9aad85 req-e22782b8-f153-479f-ab19-0ba5bac8431c tempest-ImagesTestJSON-1647743380 tempest-ImagesTestJSON-1647743380-project-member] Enqueued Resource ID: 4580d502-1d18-4681-96a4-28ac4e291d69 with Priority: HIGHEST for action security_group_members [ 1049.306325] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4580d502-1d18-4681-96a4-28ac4e291d69 with Priority: HIGHEST for action security_group_members [ 1049.306325] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4580d502-1d18-4681-96a4-28ac4e291d69 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.306325] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.306325] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.306325] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.306325] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.306325] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.306325] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.306325] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.306325] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.306325] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4580d502-1d18-4681-96a4-28ac4e291d69',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.354464] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.354619] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.354694] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.354925] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.355032] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.355242] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.355338] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.355400] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.355557] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.355634] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.355720] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 is going to be updated. [ 1049.385829] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.386118] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.386118] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.386299] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.387951] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.396302] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 in Status: IN_PROGRESS for 2s [ 1049.405547] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-175 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.405547] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-175" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.405547] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-175" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.405886] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-175" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.406200] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.406457] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.406565] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.406690] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.406848] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.407067] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1049.407215] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1049.407303] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1049.407417] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1049.407518] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1049.407625] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1049.407760] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1049.425475] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1049.425706] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1049.425916] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1049.426072] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-175" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.426489] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-9276c3db-e288-4ce3-89dd-a7dbb100ebbb taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.426704] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-9276c3db-e288-4ce3-89dd-a7dbb100ebbb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.426865] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-9276c3db-e288-4ce3-89dd-a7dbb100ebbb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.427223] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-9276c3db-e288-4ce3-89dd-a7dbb100ebbb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.427432] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9276c3db-e288-4ce3-89dd-a7dbb100ebbb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.558487] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.558659] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.558730] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.558958] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.559065] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.559725] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.559725] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.559725] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.560040] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.560040] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.560040] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e505537-e930-46b3-bee1-b6cba5260d3d already deleted. [ 1049.560040] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.808431] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.808596] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.808698] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.808889] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.808970] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.809195] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.809279] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.809344] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.809495] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.809568] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.809654] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4580d502-1d18-4681-96a4-28ac4e291d69 is going to be updated. [ 1049.836867] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.836867] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.837054] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.837257] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.837449] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.845536] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4580d502-1d18-4681-96a4-28ac4e291d69 in Status: IN_PROGRESS for 2s [ 1049.930859] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.931137] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.931273] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.931662] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.931835] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.931998] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 9276c3db-e288-4ce3-89dd-a7dbb100ebbb not found, creating... [ 1049.932372] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.932568] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.932714] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.932948] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.933119] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.933419] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.933577] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.933695] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.933935] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.934050] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.934193] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 9276c3db-e288-4ce3-89dd-a7dbb100ebbb is going to be created. [ 1049.951802] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.952042] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.952175] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.952444] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.952737] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.952969] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-9276c3db-e288-4ce3-89dd-a7dbb100ebbb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.067521] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 025fa550-df80-4c1b-a8f7-f75221e3bef7 in Status: SUCCESS [ 1050.067892] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-025fa550-df80-4c1b-a8f7-f75221e3bef7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.217097] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: SUCCESS [ 1050.217331] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.217498] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.217731] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.217931] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.218057] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.218117] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.218379] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.218379] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.218472] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.721091] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.854926] env[70764]: INFO networking_nsxv3.common.synchronization [req-67ccbaac-04ff-4469-9286-bee37f559dfd req-8febd3ba-1e2c-42a5-986d-2983756bc532 service nova] Enqueued Resource ID: 4e505537-e930-46b3-bee1-b6cba5260d3d with Priority: HIGHEST for action security_group_rules [ 1050.855191] env[70764]: INFO networking_nsxv3.common.synchronization [req-67ccbaac-04ff-4469-9286-bee37f559dfd req-8febd3ba-1e2c-42a5-986d-2983756bc532 service nova] Enqueued Resource ID: 4e505537-e930-46b3-bee1-b6cba5260d3d with Priority: HIGHEST for action security_group_members [ 1050.855256] env[70764]: INFO networking_nsxv3.common.synchronization [req-67ccbaac-04ff-4469-9286-bee37f559dfd req-8febd3ba-1e2c-42a5-986d-2983756bc532 service nova] Enqueued Resource ID: 9276c3db-e288-4ce3-89dd-a7dbb100ebbb with Priority: HIGHEST for action port [ 1050.855511] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e505537-e930-46b3-bee1-b6cba5260d3d with Priority: HIGHEST for action security_group_rules [ 1050.855649] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e505537-e930-46b3-bee1-b6cba5260d3d with Priority: HIGHEST for action security_group_members [ 1050.855849] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9276c3db-e288-4ce3-89dd-a7dbb100ebbb with Priority: HIGHEST for action port [ 1050.858682] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e505537-e930-46b3-bee1-b6cba5260d3d taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.859284] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.859284] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.859284] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.859284] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e505537-e930-46b3-bee1-b6cba5260d3d',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.860100] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e505537-e930-46b3-bee1-b6cba5260d3d taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.860217] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.860281] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.860448] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.860599] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.860700] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.860753] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.860871] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.860952] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.861091] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e505537-e930-46b3-bee1-b6cba5260d3d',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.862140] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-9276c3db-e288-4ce3-89dd-a7dbb100ebbb taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.862251] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9276c3db-e288-4ce3-89dd-a7dbb100ebbb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.862315] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9276c3db-e288-4ce3-89dd-a7dbb100ebbb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.862466] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9276c3db-e288-4ce3-89dd-a7dbb100ebbb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.862540] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9276c3db-e288-4ce3-89dd-a7dbb100ebbb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.224142] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.364392] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e505537-e930-46b3-bee1-b6cba5260d3d taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.364392] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.369020] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e505537-e930-46b3-bee1-b6cba5260d3d',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.369020] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9276c3db-e288-4ce3-89dd-a7dbb100ebbb with status ACTIVE [ 1051.369020] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.369020] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.369020] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.369020] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.369020] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.369020] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.369020] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.369020] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.369020] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.369020] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.369020] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.369020] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.369020] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.369020] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.369656] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.369656] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9276c3db-e288-4ce3-89dd-a7dbb100ebbb is going to be updated. [ 1051.390290] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.390653] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.390811] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.391284] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.392077] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.392364] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9276c3db-e288-4ce3-89dd-a7dbb100ebbb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.406379] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 in Status: SUCCESS [ 1051.406379] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9995ac6-c7bb-4911-9b05-92ca94f2c030 deletion is rescheduled due to dependency. [ 1051.406379] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9995ac6-c7bb-4911-9b05-92ca94f2c030" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.423279] env[70764]: INFO networking_nsxv3.common.synchronization [req-d9d1a8ef-30f1-4d4f-97fe-d40f85cee539 req-926d9d54-63ef-4b91-8c3e-b5a8183259f8 tempest-ServerActionsTestJSON-288318646 tempest-ServerActionsTestJSON-288318646-project-member] Enqueued Resource ID: 10a6cc00-1953-4c0f-8a12-c0405294ba0f with Priority: HIGHEST for action security_group_members [ 1051.423834] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10a6cc00-1953-4c0f-8a12-c0405294ba0f with Priority: HIGHEST for action security_group_members [ 1051.424163] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-10a6cc00-1953-4c0f-8a12-c0405294ba0f taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.424287] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10a6cc00-1953-4c0f-8a12-c0405294ba0f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.424355] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10a6cc00-1953-4c0f-8a12-c0405294ba0f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.424822] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10a6cc00-1953-4c0f-8a12-c0405294ba0f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.425009] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.425127] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.425191] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.425352] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.425435] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.425528] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10a6cc00-1953-4c0f-8a12-c0405294ba0f',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.728865] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.728865] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.728865] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.728865] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.728865] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.729214] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8f5efec-a14e-4be6-8add-7b35a995c982 is going to be updated. [ 1051.754803] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.754944] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.754944] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.755179] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.755407] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.762806] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: IN_PROGRESS for 2s [ 1051.797346] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-803 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.797593] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-803" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.797809] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-803" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.798178] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-803" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.798687] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.799227] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.799593] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.800167] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.800512] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.800922] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1051.801382] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1051.801633] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1051.801908] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1051.802143] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1051.802384] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1051.802693] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1051.829139] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1051.829373] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1051.829483] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1051.830711] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-803" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.830711] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-614908de-fa9f-4984-8dfd-7e12231706d3 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.830711] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-614908de-fa9f-4984-8dfd-7e12231706d3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.830711] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-614908de-fa9f-4984-8dfd-7e12231706d3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.830711] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-614908de-fa9f-4984-8dfd-7e12231706d3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.831959] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('614908de-fa9f-4984-8dfd-7e12231706d3',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.860189] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4580d502-1d18-4681-96a4-28ac4e291d69 in Status: SUCCESS [ 1051.860189] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4580d502-1d18-4681-96a4-28ac4e291d69 deletion is rescheduled due to dependency. [ 1051.860189] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4580d502-1d18-4681-96a4-28ac4e291d69" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.871797] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e505537-e930-46b3-bee1-b6cba5260d3d',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.928356] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.928602] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.929192] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.929390] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.929390] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.929738] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.929911] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.930030] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.930289] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.930425] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.930565] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10a6cc00-1953-4c0f-8a12-c0405294ba0f already deleted. [ 1051.930699] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10a6cc00-1953-4c0f-8a12-c0405294ba0f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.334893] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.335223] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.335410] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.335776] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.335957] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.336264] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 614908de-fa9f-4984-8dfd-7e12231706d3 not found, creating... [ 1052.336498] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.336727] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.336878] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.337143] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.337336] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.337666] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.337893] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.338084] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.338333] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.338522] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.338700] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 614908de-fa9f-4984-8dfd-7e12231706d3 is going to be created. [ 1052.358233] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.358469] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.358598] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.358890] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.359169] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.359414] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-614908de-fa9f-4984-8dfd-7e12231706d3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.374176] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.374317] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.374376] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.374569] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.374666] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.374767] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e505537-e930-46b3-bee1-b6cba5260d3d is going to be created. [ 1052.415082] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.415272] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.415325] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.415525] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.415678] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.429504] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e505537-e930-46b3-bee1-b6cba5260d3d in Status: UNINITIALIZED for 2s [ 1053.238882] env[70764]: INFO networking_nsxv3.common.synchronization [req-d9d1a8ef-30f1-4d4f-97fe-d40f85cee539 req-9c7b06f2-636d-4f91-9e3c-97c21eaaec52 service nova] Enqueued Resource ID: 10a6cc00-1953-4c0f-8a12-c0405294ba0f with Priority: HIGHEST for action security_group_rules [ 1053.239089] env[70764]: INFO networking_nsxv3.common.synchronization [req-d9d1a8ef-30f1-4d4f-97fe-d40f85cee539 req-9c7b06f2-636d-4f91-9e3c-97c21eaaec52 service nova] Enqueued Resource ID: 10a6cc00-1953-4c0f-8a12-c0405294ba0f with Priority: HIGHEST for action security_group_members [ 1053.239237] env[70764]: INFO networking_nsxv3.common.synchronization [req-d9d1a8ef-30f1-4d4f-97fe-d40f85cee539 req-9c7b06f2-636d-4f91-9e3c-97c21eaaec52 service nova] Enqueued Resource ID: 614908de-fa9f-4984-8dfd-7e12231706d3 with Priority: HIGHEST for action port [ 1053.239812] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10a6cc00-1953-4c0f-8a12-c0405294ba0f with Priority: HIGHEST for action security_group_rules [ 1053.239945] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10a6cc00-1953-4c0f-8a12-c0405294ba0f with Priority: HIGHEST for action security_group_members [ 1053.240443] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 614908de-fa9f-4984-8dfd-7e12231706d3 with Priority: HIGHEST for action port [ 1053.240856] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-10a6cc00-1953-4c0f-8a12-c0405294ba0f taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.240997] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-10a6cc00-1953-4c0f-8a12-c0405294ba0f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.241070] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-10a6cc00-1953-4c0f-8a12-c0405294ba0f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.241292] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-10a6cc00-1953-4c0f-8a12-c0405294ba0f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.241755] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('10a6cc00-1953-4c0f-8a12-c0405294ba0f',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.246027] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-10a6cc00-1953-4c0f-8a12-c0405294ba0f taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.246027] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10a6cc00-1953-4c0f-8a12-c0405294ba0f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.246027] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10a6cc00-1953-4c0f-8a12-c0405294ba0f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.246027] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10a6cc00-1953-4c0f-8a12-c0405294ba0f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.246027] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.246027] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.246027] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.246027] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.246027] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.246027] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10a6cc00-1953-4c0f-8a12-c0405294ba0f',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.246027] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-614908de-fa9f-4984-8dfd-7e12231706d3 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.246027] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-614908de-fa9f-4984-8dfd-7e12231706d3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.246027] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-614908de-fa9f-4984-8dfd-7e12231706d3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.246027] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-614908de-fa9f-4984-8dfd-7e12231706d3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.246027] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('614908de-fa9f-4984-8dfd-7e12231706d3',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.748583] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-10a6cc00-1953-4c0f-8a12-c0405294ba0f taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.748984] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10a6cc00-1953-4c0f-8a12-c0405294ba0f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.748984] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('10a6cc00-1953-4c0f-8a12-c0405294ba0f',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.749995] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 614908de-fa9f-4984-8dfd-7e12231706d3 with status ACTIVE [ 1053.750232] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.750832] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.750832] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.750832] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.750832] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.751066] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.751207] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.751277] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.751564] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.751631] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.752052] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.752052] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.752353] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.752353] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.752353] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.752558] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 614908de-fa9f-4984-8dfd-7e12231706d3 is going to be updated. [ 1053.771948] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: SUCCESS [ 1053.772184] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.772341] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.772550] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.772847] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.773086] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.773086] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.773205] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.773294] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.773381] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.773476] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.775171] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.775323] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.775382] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.775530] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.775657] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.775800] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-614908de-fa9f-4984-8dfd-7e12231706d3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.869110] env[70764]: INFO networking_nsxv3.common.synchronization [req-4010a77e-adb7-4dfe-8fda-d69f2a9eb458 req-a5894702-8e1a-4ef5-af82-41f12a519ad6 tempest-FloatingIPsAssociationTestJSON-699796548 tempest-FloatingIPsAssociationTestJSON-699796548-project-member] Enqueued Resource ID: 390854ae-4528-43fa-8fd3-61a4742be55a with Priority: HIGHEST for action security_group_members [ 1053.869553] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 390854ae-4528-43fa-8fd3-61a4742be55a with Priority: HIGHEST for action security_group_members [ 1053.869898] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-390854ae-4528-43fa-8fd3-61a4742be55a taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.870071] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.870113] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.870294] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.870445] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.870541] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.870617] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.870766] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.870853] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.870950] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('390854ae-4528-43fa-8fd3-61a4742be55a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.254137] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('10a6cc00-1953-4c0f-8a12-c0405294ba0f',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.261394] env[70764]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1054.261394] env[70764]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] NSXv3 Agent Agent loop - iteration:2 started [ 1054.277228] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.277395] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.277477] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.277713] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.277870] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.277969] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.278059] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.278210] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.278291] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.278380] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.278526] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.278615] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.278673] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.278806] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.278940] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.279044] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.279104] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.279236] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.279308] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.279387] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.279472] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.377159] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('390854ae-4528-43fa-8fd3-61a4742be55a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.406031] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-291 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.406031] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-291" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.406031] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-291" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.406272] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-291" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.406548] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.406716] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.406835] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.409259] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.410633] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.410939] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1054.411145] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1054.411317] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1054.411477] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1054.411640] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1054.411798] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1054.411986] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1054.431082] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1054.431310] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1054.431488] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1054.431694] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-291" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.432072] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-1224d27d-849b-4e05-97b8-9f4519136dc9 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.432291] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-1224d27d-849b-4e05-97b8-9f4519136dc9" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.432434] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-1224d27d-849b-4e05-97b8-9f4519136dc9" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.432806] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-1224d27d-849b-4e05-97b8-9f4519136dc9" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.432979] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1224d27d-849b-4e05-97b8-9f4519136dc9',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.442672] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e505537-e930-46b3-bee1-b6cba5260d3d in Status: SUCCESS [ 1054.443334] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.443531] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.443722] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.443939] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.444073] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.444189] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.444300] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.444380] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.444505] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.444552] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4e505537-e930-46b3-bee1-b6cba5260d3d',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.757022] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.757022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.757022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.757022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.757022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.757022] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10a6cc00-1953-4c0f-8a12-c0405294ba0f is going to be created. [ 1054.782525] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f8f5efec-a14e-4be6-8add-7b35a995c982: rpc.has_security_group_logging(os_id): False [ 1054.785083] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.785229] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.785291] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.785500] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.785656] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.794191] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10a6cc00-1953-4c0f-8a12-c0405294ba0f in Status: UNINITIALIZED for 2s [ 1054.802608] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.802823] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.802897] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.803128] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.803218] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.803411] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.803507] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.803570] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.803721] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.803792] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.804020] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.804123] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.804181] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.804326] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.804395] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.804579] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.804669] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.804729] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.804869] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.804945] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.805130] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8f5efec-a14e-4be6-8add-7b35a995c982 is going to be updated. [ 1054.879308] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('390854ae-4528-43fa-8fd3-61a4742be55a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.887265] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.887520] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.888417] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.888417] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.888417] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.902457] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: IN_PROGRESS for 2s [ 1054.937690] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.937928] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.938072] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.938431] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.938759] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.938842] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 1224d27d-849b-4e05-97b8-9f4519136dc9 not found, creating... [ 1054.939164] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.939335] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.939456] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.939673] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.939818] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.940311] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.940598] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.940810] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.941112] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.941345] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.941691] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 1224d27d-849b-4e05-97b8-9f4519136dc9 is going to be created. [ 1054.950723] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4e505537-e930-46b3-bee1-b6cba5260d3d',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.972422] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.972650] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.972826] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.973138] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.973435] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.973601] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-1224d27d-849b-4e05-97b8-9f4519136dc9" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.382447] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.382663] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.382739] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.383027] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.383155] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.383344] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 390854ae-4528-43fa-8fd3-61a4742be55a is going to be updated. [ 1055.414905] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.414905] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.414905] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.414905] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.415093] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.423255] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 390854ae-4528-43fa-8fd3-61a4742be55a in Status: IN_PROGRESS for 2s [ 1055.454767] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4e505537-e930-46b3-bee1-b6cba5260d3d: rpc.has_security_group_logging(os_id): False [ 1055.471118] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.471303] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.471350] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.471610] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.471806] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.472117] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.472311] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.472311] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.472446] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.472525] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.472610] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e505537-e930-46b3-bee1-b6cba5260d3d is going to be created. [ 1055.541039] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.541173] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.541240] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.541451] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.541623] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.553482] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e505537-e930-46b3-bee1-b6cba5260d3d in Status: IN_PROGRESS for 2s [ 1055.819021] env[70764]: INFO networking_nsxv3.common.synchronization [req-4010a77e-adb7-4dfe-8fda-d69f2a9eb458 req-a0037823-a7b4-4c29-9d2b-7fd9a1a805ba service nova] Enqueued Resource ID: 390854ae-4528-43fa-8fd3-61a4742be55a with Priority: HIGHEST for action security_group_rules [ 1055.819021] env[70764]: INFO networking_nsxv3.common.synchronization [req-4010a77e-adb7-4dfe-8fda-d69f2a9eb458 req-a0037823-a7b4-4c29-9d2b-7fd9a1a805ba service nova] Enqueued Resource ID: 390854ae-4528-43fa-8fd3-61a4742be55a with Priority: HIGHEST for action security_group_members [ 1055.819021] env[70764]: INFO networking_nsxv3.common.synchronization [req-4010a77e-adb7-4dfe-8fda-d69f2a9eb458 req-a0037823-a7b4-4c29-9d2b-7fd9a1a805ba service nova] Enqueued Resource ID: 1224d27d-849b-4e05-97b8-9f4519136dc9 with Priority: HIGHEST for action port [ 1055.819021] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 390854ae-4528-43fa-8fd3-61a4742be55a with Priority: HIGHEST for action security_group_rules [ 1055.819021] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 390854ae-4528-43fa-8fd3-61a4742be55a with Priority: HIGHEST for action security_group_members [ 1055.819021] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1224d27d-849b-4e05-97b8-9f4519136dc9 with Priority: HIGHEST for action port [ 1055.819831] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-390854ae-4528-43fa-8fd3-61a4742be55a taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.820628] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.820628] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.820628] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.820628] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('390854ae-4528-43fa-8fd3-61a4742be55a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.821305] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-390854ae-4528-43fa-8fd3-61a4742be55a taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.821403] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.821593] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-1224d27d-849b-4e05-97b8-9f4519136dc9 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.821691] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1224d27d-849b-4e05-97b8-9f4519136dc9" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.821754] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1224d27d-849b-4e05-97b8-9f4519136dc9" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.821918] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1224d27d-849b-4e05-97b8-9f4519136dc9" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.821993] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1224d27d-849b-4e05-97b8-9f4519136dc9',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.325009] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-390854ae-4528-43fa-8fd3-61a4742be55a taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.325440] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.327458] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1224d27d-849b-4e05-97b8-9f4519136dc9 with status ACTIVE [ 1056.327735] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.327983] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.328072] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.328319] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.328475] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.328687] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.328794] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.328903] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.329129] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.331998] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.331998] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.331998] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.331998] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.331998] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.331998] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.331998] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1224d27d-849b-4e05-97b8-9f4519136dc9 is going to be updated. [ 1056.349698] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.349823] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.349918] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.350754] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.350964] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.351161] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1224d27d-849b-4e05-97b8-9f4519136dc9" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.488046] env[70764]: INFO networking_nsxv3.common.synchronization [req-ac651c3c-e961-4e6b-a489-3cec23b55ce7 req-ead835ab-bc8b-4226-b917-c78e542197d8 tempest-ServerRescueNegativeTestJSON-1208111124 tempest-ServerRescueNegativeTestJSON-1208111124-project-member] Enqueued Resource ID: 1f7d8ca5-61df-4ea2-b964-843e08d1b082 with Priority: HIGHEST for action security_group_members [ 1056.488626] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f7d8ca5-61df-4ea2-b964-843e08d1b082 with Priority: HIGHEST for action security_group_members [ 1056.488931] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f7d8ca5-61df-4ea2-b964-843e08d1b082 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.489270] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.489386] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.489661] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.489726] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.489802] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.489863] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.490015] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.490120] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.490179] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f7d8ca5-61df-4ea2-b964-843e08d1b082',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.803104] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10a6cc00-1953-4c0f-8a12-c0405294ba0f in Status: SUCCESS [ 1056.803330] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10a6cc00-1953-4c0f-8a12-c0405294ba0f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.803488] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10a6cc00-1953-4c0f-8a12-c0405294ba0f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.803702] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10a6cc00-1953-4c0f-8a12-c0405294ba0f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.803891] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.804045] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.804103] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.804233] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.804309] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.804383] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10a6cc00-1953-4c0f-8a12-c0405294ba0f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.804467] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('10a6cc00-1953-4c0f-8a12-c0405294ba0f',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.918229] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: SUCCESS [ 1056.918551] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.995370] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.995370] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.995370] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.995370] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.995370] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.995370] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.995370] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.995370] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.995840] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.995840] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.995840] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f7d8ca5-61df-4ea2-b964-843e08d1b082 is going to be updated. [ 1057.005709] env[70764]: INFO networking_nsxv3.common.synchronization [req-f05a6090-9908-4035-b792-ebe444864222 req-ff2c1499-cb00-422e-b705-354d2b2bfbd3 tempest-DeleteServersTestJSON-1788501793 tempest-DeleteServersTestJSON-1788501793-project-member] Enqueued Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGHEST for action security_group_members [ 1057.006328] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGHEST for action security_group_members [ 1057.006640] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-3379805b-13ae-4057-9511-570e8b3c2437 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.006763] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.006855] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.007035] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.007188] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.007287] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.007346] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.007491] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.007589] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.007679] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3379805b-13ae-4057-9511-570e8b3c2437',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.022966] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.023136] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.023212] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.023407] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.023535] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.036324] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f7d8ca5-61df-4ea2-b964-843e08d1b082 in Status: IN_PROGRESS for 2s [ 1057.306393] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('10a6cc00-1953-4c0f-8a12-c0405294ba0f',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.432800] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 390854ae-4528-43fa-8fd3-61a4742be55a in Status: SUCCESS [ 1057.433039] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.433204] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.433414] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.433596] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.433708] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.433787] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.433979] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.434071] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.434167] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('390854ae-4528-43fa-8fd3-61a4742be55a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.511721] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.511721] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.511721] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.511938] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.512818] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.512818] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.512818] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.512818] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.512818] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.512818] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.512818] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3379805b-13ae-4057-9511-570e8b3c2437 is going to be updated. [ 1057.560481] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.560717] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.560774] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.560950] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.561102] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.568626] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e505537-e930-46b3-bee1-b6cba5260d3d in Status: SUCCESS [ 1057.568626] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.569067] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3379805b-13ae-4057-9511-570e8b3c2437 in Status: IN_PROGRESS for 2s [ 1057.811720] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 10a6cc00-1953-4c0f-8a12-c0405294ba0f: rpc.has_security_group_logging(os_id): False [ 1057.839110] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.839265] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.839389] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.839639] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.839836] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.840237] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.840421] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.840516] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.840688] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.840806] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.840908] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 10a6cc00-1953-4c0f-8a12-c0405294ba0f is going to be created. [ 1057.917369] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.917550] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.917600] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.917782] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.917957] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.936024] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 10a6cc00-1953-4c0f-8a12-c0405294ba0f in Status: IN_PROGRESS for 2s [ 1057.936374] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('390854ae-4528-43fa-8fd3-61a4742be55a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.439214] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('390854ae-4528-43fa-8fd3-61a4742be55a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.942763] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.942763] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.942763] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.942763] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.942763] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.942763] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 390854ae-4528-43fa-8fd3-61a4742be55a is going to be updated. [ 1058.968009] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.968159] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.968207] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.968376] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.968511] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.976422] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 390854ae-4528-43fa-8fd3-61a4742be55a in Status: IN_PROGRESS for 2s [ 1059.047430] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f7d8ca5-61df-4ea2-b964-843e08d1b082 in Status: SUCCESS [ 1059.048478] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f7d8ca5-61df-4ea2-b964-843e08d1b082 deletion is rescheduled due to dependency. [ 1059.048478] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.369140] env[70764]: INFO networking_nsxv3.common.synchronization [None req-e9b39e25-bbce-48fd-9733-d055d21a9b1e tempest-ServerDiskConfigTestJSON-1914051978 tempest-ServerDiskConfigTestJSON-1914051978-project-member] Enqueued Resource ID: 617a30c6-8a11-42b7-8461-e568f1f31392 with Priority: HIGHEST for action security_group_rules [ 1059.369855] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 617a30c6-8a11-42b7-8461-e568f1f31392 with Priority: HIGHEST for action security_group_rules [ 1059.370305] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-617a30c6-8a11-42b7-8461-e568f1f31392 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.370488] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-617a30c6-8a11-42b7-8461-e568f1f31392" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.370590] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-617a30c6-8a11-42b7-8461-e568f1f31392" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.370967] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-617a30c6-8a11-42b7-8461-e568f1f31392" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.371107] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('617a30c6-8a11-42b7-8461-e568f1f31392',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.458028] env[70764]: INFO networking_nsxv3.common.synchronization [None req-c82db433-d791-4caa-8d2c-fb85b5a96680 tempest-ServerDiskConfigTestJSON-1914051978 tempest-ServerDiskConfigTestJSON-1914051978-project-member] Enqueued Resource ID: 617a30c6-8a11-42b7-8461-e568f1f31392 with Priority: HIGHEST for action security_group_rules [ 1059.458443] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 617a30c6-8a11-42b7-8461-e568f1f31392 with Priority: HIGHEST for action security_group_rules [ 1059.458754] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-617a30c6-8a11-42b7-8461-e568f1f31392 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.459485] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-617a30c6-8a11-42b7-8461-e568f1f31392" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.579569] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3379805b-13ae-4057-9511-570e8b3c2437 in Status: SUCCESS [ 1059.579569] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3379805b-13ae-4057-9511-570e8b3c2437 deletion is rescheduled due to dependency. [ 1059.579569] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.894021] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.894021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.894021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.894021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.894021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.894021] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 617a30c6-8a11-42b7-8461-e568f1f31392 already deleted. [ 1059.894021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-617a30c6-8a11-42b7-8461-e568f1f31392" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.894021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-617a30c6-8a11-42b7-8461-e568f1f31392" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.894021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-617a30c6-8a11-42b7-8461-e568f1f31392" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.894021] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('617a30c6-8a11-42b7-8461-e568f1f31392',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.909877] env[70764]: INFO networking_nsxv3.common.synchronization [req-9c4af92b-12da-4ac9-9607-97c48d76d827 req-09f69efd-c0e6-4b47-b1b5-d360157c095f tempest-ServersTestJSON-88830314 tempest-ServersTestJSON-88830314-project-member] Enqueued Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_members [ 1059.910488] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_members [ 1059.910819] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.910956] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.911542] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.911792] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.912558] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.912558] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.912558] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.913070] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.913070] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.913070] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.947182] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 10a6cc00-1953-4c0f-8a12-c0405294ba0f in Status: SUCCESS [ 1059.947488] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-10a6cc00-1953-4c0f-8a12-c0405294ba0f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.415253] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.417314] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.417459] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.417544] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.417755] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.417862] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.418313] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 617a30c6-8a11-42b7-8461-e568f1f31392 already deleted. [ 1060.418510] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-617a30c6-8a11-42b7-8461-e568f1f31392" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.920949] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.986299] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 390854ae-4528-43fa-8fd3-61a4742be55a in Status: SUCCESS [ 1060.986607] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.986700] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.986979] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.987130] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.987364] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.987364] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.987493] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.987537] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.987600] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.987695] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('390854ae-4528-43fa-8fd3-61a4742be55a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.426519] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.426519] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.426519] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.426519] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.426519] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.426972] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8f5efec-a14e-4be6-8add-7b35a995c982 is going to be updated. [ 1061.459592] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.459822] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.459908] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.460238] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.460447] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.472434] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: IN_PROGRESS for 2s [ 1061.490278] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-390854ae-4528-43fa-8fd3-61a4742be55a taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.490456] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.490523] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.490985] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.490985] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.491148] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.491148] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.491305] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.491389] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.491490] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.491901] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-390854ae-4528-43fa-8fd3-61a4742be55a taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.491901] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.491901] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.492226] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.492226] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.492226] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.492417] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.492417] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.492537] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.492650] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.492650] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('390854ae-4528-43fa-8fd3-61a4742be55a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.995084] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 390854ae-4528-43fa-8fd3-61a4742be55a: rpc.has_security_group_logging(os_id): False [ 1062.011742] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.011983] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.011983] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.012238] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.012347] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.012560] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.012660] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.012720] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.012972] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.013037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.013222] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.013316] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.013368] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.013513] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.013580] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.013768] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.013865] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.013931] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.014087] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.014162] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.014247] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 390854ae-4528-43fa-8fd3-61a4742be55a is going to be updated. [ 1062.073633] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.073793] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.073861] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.074105] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.074266] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.085746] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 390854ae-4528-43fa-8fd3-61a4742be55a in Status: IN_PROGRESS for 2s [ 1062.699170] env[70764]: INFO networking_nsxv3.common.synchronization [req-2557ed4b-a67a-44b3-83eb-44ac2a1aaec4 req-386fbc9f-03c6-4584-b2c0-9e4085749aac tempest-ServerDiskConfigTestJSON-1914051978 tempest-ServerDiskConfigTestJSON-1914051978-project-member] Enqueued Resource ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 with Priority: HIGHEST for action security_group_members [ 1062.699534] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 with Priority: HIGHEST for action security_group_members [ 1062.699856] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-56646d46-eb79-4ebc-a596-a5a17716f8e4 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.699983] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.700394] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.700646] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.700884] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.700995] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.701148] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.701333] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.701448] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.701581] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56646d46-eb79-4ebc-a596-a5a17716f8e4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.206405] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.206824] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.206824] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.207039] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.207155] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.207374] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.207482] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.207546] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.207703] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.207785] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.207874] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 is going to be updated. [ 1063.237122] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.237369] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.237449] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.237667] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.237833] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.247529] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 in Status: IN_PROGRESS for 2s [ 1063.482211] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: SUCCESS [ 1063.482443] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.097689] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 390854ae-4528-43fa-8fd3-61a4742be55a in Status: SUCCESS [ 1064.097906] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.256987] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 in Status: SUCCESS [ 1065.257386] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 deletion is rescheduled due to dependency. [ 1065.257386] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.499452] env[70764]: INFO networking_nsxv3.common.synchronization [None req-96558643-4bef-418f-b2e6-cb237a5e0c35 tempest-AttachVolumeNegativeTest-232785497 tempest-AttachVolumeNegativeTest-232785497-project-member] Enqueued Resource ID: 433d7528-b29b-4b58-848d-9e981ea88344 with Priority: HIGHEST for action security_group_rules [ 1065.500221] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 433d7528-b29b-4b58-848d-9e981ea88344 with Priority: HIGHEST for action security_group_rules [ 1065.500322] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-433d7528-b29b-4b58-848d-9e981ea88344 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.500991] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-433d7528-b29b-4b58-848d-9e981ea88344" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.500991] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-433d7528-b29b-4b58-848d-9e981ea88344" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.500991] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-433d7528-b29b-4b58-848d-9e981ea88344" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.500991] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('433d7528-b29b-4b58-848d-9e981ea88344',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.588020] env[70764]: INFO networking_nsxv3.common.synchronization [None req-4caa6e5f-7e49-4961-98cb-5a94fa0f8650 tempest-AttachVolumeNegativeTest-232785497 tempest-AttachVolumeNegativeTest-232785497-project-member] Enqueued Resource ID: 433d7528-b29b-4b58-848d-9e981ea88344 with Priority: HIGHEST for action security_group_rules [ 1065.588455] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 433d7528-b29b-4b58-848d-9e981ea88344 with Priority: HIGHEST for action security_group_rules [ 1065.588764] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-433d7528-b29b-4b58-848d-9e981ea88344 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.588872] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-433d7528-b29b-4b58-848d-9e981ea88344" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.027023] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.027023] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.027023] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.027023] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.027023] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.027023] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 433d7528-b29b-4b58-848d-9e981ea88344 already deleted. [ 1066.027023] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-433d7528-b29b-4b58-848d-9e981ea88344" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.027023] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-433d7528-b29b-4b58-848d-9e981ea88344" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.027023] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-433d7528-b29b-4b58-848d-9e981ea88344" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.027023] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('433d7528-b29b-4b58-848d-9e981ea88344',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.550014] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.550397] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.550397] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.550583] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.550713] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.550848] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 433d7528-b29b-4b58-848d-9e981ea88344 already deleted. [ 1066.550925] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-433d7528-b29b-4b58-848d-9e981ea88344" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.589290] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1070.589562] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1071.841462] env[70764]: INFO networking_nsxv3.common.synchronization [req-575faad5-b0e9-44b3-b4a1-4d3278a7737e req-bc5ca8ba-0a42-4048-86df-35b6ea815378 tempest-FloatingIPsAssociationTestJSON-699796548 tempest-FloatingIPsAssociationTestJSON-699796548-project-member] Enqueued Resource ID: 390854ae-4528-43fa-8fd3-61a4742be55a with Priority: HIGHEST for action security_group_members [ 1071.841462] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 390854ae-4528-43fa-8fd3-61a4742be55a with Priority: HIGHEST for action security_group_members [ 1071.841462] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-390854ae-4528-43fa-8fd3-61a4742be55a taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.841462] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.841462] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.841462] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.841918] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.842161] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.842259] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.842383] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.842477] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.842599] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('390854ae-4528-43fa-8fd3-61a4742be55a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.346799] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('390854ae-4528-43fa-8fd3-61a4742be55a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.786149] env[70764]: INFO networking_nsxv3.common.synchronization [None req-0a05e953-c753-43df-961d-341f448af770 None None] Enqueued Resource ID: a75c8bbe-52aa-444f-9766-5e6a42303f53 with Priority: HIGHEST for action port [ 1072.786365] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a75c8bbe-52aa-444f-9766-5e6a42303f53 with Priority: HIGHEST for action port [ 1072.787605] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-a75c8bbe-52aa-444f-9766-5e6a42303f53 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.787735] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a75c8bbe-52aa-444f-9766-5e6a42303f53" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.787804] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a75c8bbe-52aa-444f-9766-5e6a42303f53" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.788086] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a75c8bbe-52aa-444f-9766-5e6a42303f53" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.788173] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a75c8bbe-52aa-444f-9766-5e6a42303f53',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.849958] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('390854ae-4528-43fa-8fd3-61a4742be55a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.291131] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a75c8bbe-52aa-444f-9766-5e6a42303f53 [ 1073.291280] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.292089] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.292089] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.292263] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.292263] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.292345] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a75c8bbe-52aa-444f-9766-5e6a42303f53 already deleted. [ 1073.292428] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a75c8bbe-52aa-444f-9766-5e6a42303f53" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.355280] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.355993] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.355993] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.356673] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.356851] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.356977] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 390854ae-4528-43fa-8fd3-61a4742be55a is going to be updated. [ 1073.387433] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.387587] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.387670] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.387899] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.388074] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.401035] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 390854ae-4528-43fa-8fd3-61a4742be55a in Status: IN_PROGRESS for 2s [ 1074.289394] env[70764]: INFO networking_nsxv3.common.synchronization [req-6b8c3888-f968-45f5-9d50-490c37493ff8 req-f3a2eb06-8625-4035-8001-f09127ddfded tempest-DeleteServersTestJSON-1788501793 tempest-DeleteServersTestJSON-1788501793-project-member] Enqueued Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGHEST for action security_group_members [ 1074.289969] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGHEST for action security_group_members [ 1074.291785] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-3379805b-13ae-4057-9511-570e8b3c2437 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.291999] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.291999] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.292191] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.292351] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.292454] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.292512] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.292657] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.292737] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.292828] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3379805b-13ae-4057-9511-570e8b3c2437',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.680130] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-974 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.680340] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-974" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.680934] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-974" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.680934] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-974" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.681104] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.681217] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.681342] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.681559] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.681705] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.681945] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1074.682032] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1074.682141] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1074.682246] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1074.682353] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1074.682468] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1074.682600] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1074.700448] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1074.700448] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1074.700614] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1074.700748] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-974" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.701066] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-1aa4920d-74c2-4b58-a8f5-1cd2c492a648 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.701268] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-1aa4920d-74c2-4b58-a8f5-1cd2c492a648" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.701396] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-1aa4920d-74c2-4b58-a8f5-1cd2c492a648" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.701733] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-1aa4920d-74c2-4b58-a8f5-1cd2c492a648" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.701865] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1aa4920d-74c2-4b58-a8f5-1cd2c492a648',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.795464] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.795737] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.795837] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.796132] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.796282] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.796526] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.796678] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.796777] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.797008] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.797512] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.797669] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3379805b-13ae-4057-9511-570e8b3c2437 is going to be updated. [ 1074.824379] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.824561] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.824662] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.828850] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.828850] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.835338] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3379805b-13ae-4057-9511-570e8b3c2437 in Status: IN_PROGRESS for 2s [ 1074.983436] env[70764]: INFO networking_nsxv3.common.synchronization [None req-176741e1-a725-488f-a15d-6f7c9a82232e None None] Enqueued Resource ID: 3ff49daa-3c0b-4690-a2c9-6b4f4f32896c with Priority: HIGHEST for action port [ 1074.983982] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ff49daa-3c0b-4690-a2c9-6b4f4f32896c with Priority: HIGHEST for action port [ 1074.984387] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ff49daa-3c0b-4690-a2c9-6b4f4f32896c taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.984500] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ff49daa-3c0b-4690-a2c9-6b4f4f32896c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.984577] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ff49daa-3c0b-4690-a2c9-6b4f4f32896c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.984807] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ff49daa-3c0b-4690-a2c9-6b4f4f32896c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.985249] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ff49daa-3c0b-4690-a2c9-6b4f4f32896c',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.205667] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.205667] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.205861] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.206014] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.206170] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.206333] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 1aa4920d-74c2-4b58-a8f5-1cd2c492a648 not found, creating... [ 1075.206656] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.206858] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.206984] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.207220] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.207704] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.208013] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.208174] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.211064] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.211064] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.211064] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.211064] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 1aa4920d-74c2-4b58-a8f5-1cd2c492a648 is going to be created. [ 1075.231502] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.231707] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.233092] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.233472] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.233792] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.234230] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-1aa4920d-74c2-4b58-a8f5-1cd2c492a648" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.410992] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 390854ae-4528-43fa-8fd3-61a4742be55a in Status: SUCCESS [ 1075.411229] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.487078] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3ff49daa-3c0b-4690-a2c9-6b4f4f32896c [ 1075.487078] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.487260] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.487260] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.487445] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.487527] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.487628] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3ff49daa-3c0b-4690-a2c9-6b4f4f32896c already deleted. [ 1075.487710] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ff49daa-3c0b-4690-a2c9-6b4f4f32896c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.291952] env[70764]: INFO networking_nsxv3.common.synchronization [req-6b8c3888-f968-45f5-9d50-490c37493ff8 req-87867c77-80c0-4015-aebc-e4c8985781b0 service nova] Enqueued Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGHEST for action security_group_rules [ 1076.291952] env[70764]: INFO networking_nsxv3.common.synchronization [req-6b8c3888-f968-45f5-9d50-490c37493ff8 req-87867c77-80c0-4015-aebc-e4c8985781b0 service nova] Enqueued Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGHEST for action security_group_members [ 1076.291952] env[70764]: INFO networking_nsxv3.common.synchronization [req-6b8c3888-f968-45f5-9d50-490c37493ff8 req-87867c77-80c0-4015-aebc-e4c8985781b0 service nova] Enqueued Resource ID: 1aa4920d-74c2-4b58-a8f5-1cd2c492a648 with Priority: HIGHEST for action port [ 1076.291952] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGHEST for action security_group_rules [ 1076.291952] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGHEST for action security_group_members [ 1076.294701] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1aa4920d-74c2-4b58-a8f5-1cd2c492a648 with Priority: HIGHEST for action port [ 1076.294701] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3379805b-13ae-4057-9511-570e8b3c2437 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.294701] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.294701] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.298087] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.298087] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3379805b-13ae-4057-9511-570e8b3c2437',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.299223] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-3379805b-13ae-4057-9511-570e8b3c2437 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.299223] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.299656] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-1aa4920d-74c2-4b58-a8f5-1cd2c492a648 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.299769] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1aa4920d-74c2-4b58-a8f5-1cd2c492a648" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.299820] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1aa4920d-74c2-4b58-a8f5-1cd2c492a648" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.299982] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1aa4920d-74c2-4b58-a8f5-1cd2c492a648" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.300075] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1aa4920d-74c2-4b58-a8f5-1cd2c492a648',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.740097] env[70764]: INFO networking_nsxv3.common.synchronization [None req-d34ed14a-c304-4ac7-9fcd-0f69d7a69677 None None] Enqueued Resource ID: 13bb732e-5bfe-43ff-9c3b-a8e24ea8fc33 with Priority: HIGHEST for action port [ 1076.740389] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13bb732e-5bfe-43ff-9c3b-a8e24ea8fc33 with Priority: HIGHEST for action port [ 1076.740916] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-13bb732e-5bfe-43ff-9c3b-a8e24ea8fc33 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.741063] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-13bb732e-5bfe-43ff-9c3b-a8e24ea8fc33" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.741117] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-13bb732e-5bfe-43ff-9c3b-a8e24ea8fc33" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.741394] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-13bb732e-5bfe-43ff-9c3b-a8e24ea8fc33" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.741429] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13bb732e-5bfe-43ff-9c3b-a8e24ea8fc33',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.770214] env[70764]: INFO networking_nsxv3.common.synchronization [req-a96d0b35-5b37-465e-9ac5-55ffa95df684 req-6b663e39-00a0-4ed7-ac4a-09f2b61d7d13 tempest-ServerDiskConfigTestJSON-1914051978 tempest-ServerDiskConfigTestJSON-1914051978-project-member] Enqueued Resource ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 with Priority: HIGHEST for action security_group_members [ 1076.770214] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 with Priority: HIGHEST for action security_group_members [ 1076.770214] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-56646d46-eb79-4ebc-a596-a5a17716f8e4 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.770214] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.770420] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.770508] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.771574] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.771574] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.771574] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.771574] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.772259] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.772259] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56646d46-eb79-4ebc-a596-a5a17716f8e4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.802281] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-3379805b-13ae-4057-9511-570e8b3c2437 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.802438] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.802642] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1aa4920d-74c2-4b58-a8f5-1cd2c492a648 with status ACTIVE [ 1076.802836] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.802969] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.803053] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.803328] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.804376] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.804376] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.804376] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.804376] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.804376] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.804376] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.804376] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.804661] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.804661] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.804732] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.804768] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.804860] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1aa4920d-74c2-4b58-a8f5-1cd2c492a648 is going to be updated. [ 1076.826041] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.826222] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.826312] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.826546] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.826712] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.826884] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1aa4920d-74c2-4b58-a8f5-1cd2c492a648" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.843596] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3379805b-13ae-4057-9511-570e8b3c2437 in Status: SUCCESS [ 1076.843773] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3379805b-13ae-4057-9511-570e8b3c2437 deletion is rescheduled due to dependency. [ 1076.844062] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.844062] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.844253] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.844432] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.844545] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.844609] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.844761] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.844841] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.844930] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3379805b-13ae-4057-9511-570e8b3c2437',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.243144] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 13bb732e-5bfe-43ff-9c3b-a8e24ea8fc33 [ 1077.243392] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.243529] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.243596] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.243804] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.243894] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.243986] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:13bb732e-5bfe-43ff-9c3b-a8e24ea8fc33 already deleted. [ 1077.244077] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-13bb732e-5bfe-43ff-9c3b-a8e24ea8fc33" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.274589] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.274870] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.274870] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.275030] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.275126] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.275323] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.275418] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.275482] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.275645] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.275697] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.275878] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 is going to be updated. [ 1077.301570] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.301570] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.301570] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.301570] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.301570] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.310996] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 in Status: IN_PROGRESS for 2s [ 1077.348459] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3379805b-13ae-4057-9511-570e8b3c2437',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.364593] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-829 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.364694] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-829" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.364792] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-829" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.365066] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-829" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.365328] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.365486] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.365603] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.366674] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.366674] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.366674] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1077.366674] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1077.366674] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1077.366674] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1077.366674] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1077.366674] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1077.367149] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1077.383833] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1077.384109] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1077.384332] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1077.384559] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-829" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.384922] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-adfecf11-f64d-4bec-bf2b-28f99fcebdfb taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.385202] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-adfecf11-f64d-4bec-bf2b-28f99fcebdfb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.385340] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-adfecf11-f64d-4bec-bf2b-28f99fcebdfb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.385698] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-adfecf11-f64d-4bec-bf2b-28f99fcebdfb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.385880] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('adfecf11-f64d-4bec-bf2b-28f99fcebdfb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.849978] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3379805b-13ae-4057-9511-570e8b3c2437',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.888143] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.888342] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.888491] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.888767] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.888922] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.889085] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port adfecf11-f64d-4bec-bf2b-28f99fcebdfb not found, creating... [ 1077.889997] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.889997] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.889997] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.889997] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.889997] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.890346] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.890519] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.890632] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.890894] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.891091] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.891268] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: adfecf11-f64d-4bec-bf2b-28f99fcebdfb is going to be created. [ 1077.910926] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.911222] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.911348] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.911613] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.911840] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.912085] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-adfecf11-f64d-4bec-bf2b-28f99fcebdfb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.352469] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.352647] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.352721] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.352941] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.353062] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.353231] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3379805b-13ae-4057-9511-570e8b3c2437 is going to be updated. [ 1078.380390] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.380541] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.380597] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.380803] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.380943] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.388467] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3379805b-13ae-4057-9511-570e8b3c2437 in Status: IN_PROGRESS for 2s [ 1078.660460] env[70764]: INFO networking_nsxv3.common.synchronization [req-a96d0b35-5b37-465e-9ac5-55ffa95df684 req-bb75d737-f943-4097-b436-30d3e3b35015 service nova] Enqueued Resource ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 with Priority: HIGHEST for action security_group_rules [ 1078.660641] env[70764]: INFO networking_nsxv3.common.synchronization [req-a96d0b35-5b37-465e-9ac5-55ffa95df684 req-bb75d737-f943-4097-b436-30d3e3b35015 service nova] Enqueued Resource ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 with Priority: HIGHEST for action security_group_members [ 1078.662355] env[70764]: INFO networking_nsxv3.common.synchronization [req-a96d0b35-5b37-465e-9ac5-55ffa95df684 req-bb75d737-f943-4097-b436-30d3e3b35015 service nova] Enqueued Resource ID: adfecf11-f64d-4bec-bf2b-28f99fcebdfb with Priority: HIGHEST for action port [ 1078.662355] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 with Priority: HIGHEST for action security_group_rules [ 1078.662355] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 with Priority: HIGHEST for action security_group_members [ 1078.662355] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adfecf11-f64d-4bec-bf2b-28f99fcebdfb with Priority: HIGHEST for action port [ 1078.662355] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-56646d46-eb79-4ebc-a596-a5a17716f8e4 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.662355] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.662355] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.662355] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.662355] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('56646d46-eb79-4ebc-a596-a5a17716f8e4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.663685] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-56646d46-eb79-4ebc-a596-a5a17716f8e4 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.663783] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.663978] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-adfecf11-f64d-4bec-bf2b-28f99fcebdfb taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.664090] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-adfecf11-f64d-4bec-bf2b-28f99fcebdfb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.664152] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-adfecf11-f64d-4bec-bf2b-28f99fcebdfb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.664341] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-adfecf11-f64d-4bec-bf2b-28f99fcebdfb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.664416] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('adfecf11-f64d-4bec-bf2b-28f99fcebdfb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.900417] env[70764]: INFO networking_nsxv3.common.synchronization [req-ccfc6d46-2a48-4340-a427-dfbc72b866d1 req-2bfafa87-aff7-41bb-93dc-007239f47594 tempest-AttachVolumeNegativeTest-232785497 tempest-AttachVolumeNegativeTest-232785497-project-member] Enqueued Resource ID: 433d7528-b29b-4b58-848d-9e981ea88344 with Priority: HIGHEST for action security_group_members [ 1078.901742] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 433d7528-b29b-4b58-848d-9e981ea88344 with Priority: HIGHEST for action security_group_members [ 1078.902098] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-433d7528-b29b-4b58-848d-9e981ea88344 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.902223] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-433d7528-b29b-4b58-848d-9e981ea88344" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.902902] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-433d7528-b29b-4b58-848d-9e981ea88344" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.903255] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-433d7528-b29b-4b58-848d-9e981ea88344" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.903418] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.903534] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.903598] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.903759] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.903843] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.903937] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('433d7528-b29b-4b58-848d-9e981ea88344',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.999103] env[70764]: INFO networking_nsxv3.common.synchronization [None req-d2444419-e31e-4a88-9217-0c993a3df161 None None] Enqueued Resource ID: 5213eca1-1629-4d3e-93bd-0ade688f6269 with Priority: HIGHEST for action port [ 1078.999378] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5213eca1-1629-4d3e-93bd-0ade688f6269 with Priority: HIGHEST for action port [ 1078.999926] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-5213eca1-1629-4d3e-93bd-0ade688f6269 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.001845] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5213eca1-1629-4d3e-93bd-0ade688f6269" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.001953] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5213eca1-1629-4d3e-93bd-0ade688f6269" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.002418] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5213eca1-1629-4d3e-93bd-0ade688f6269" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.002528] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5213eca1-1629-4d3e-93bd-0ade688f6269',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.166364] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-56646d46-eb79-4ebc-a596-a5a17716f8e4 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.166483] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.166651] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port adfecf11-f64d-4bec-bf2b-28f99fcebdfb with status ACTIVE [ 1079.166806] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.167053] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.167053] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.167240] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.167339] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.167547] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.167659] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.167700] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.167847] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.167917] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.168139] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.168226] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.168275] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.168491] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.168491] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.168565] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: adfecf11-f64d-4bec-bf2b-28f99fcebdfb is going to be updated. [ 1079.180707] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-985 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.180897] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-985" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.181041] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-985" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.181322] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-985" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.181579] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.181863] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.181863] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.182237] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.182407] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.182616] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1079.182730] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1079.182833] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1079.182941] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1079.183061] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1079.183187] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1079.183707] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1079.205040] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.205620] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.205620] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.205620] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.205620] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.205786] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-adfecf11-f64d-4bec-bf2b-28f99fcebdfb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.213654] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1079.213813] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1079.214041] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1079.214174] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-985" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.214489] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-74c75906-e1ed-4382-9ea8-0d933ab545ca taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.214663] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-74c75906-e1ed-4382-9ea8-0d933ab545ca" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.214884] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-74c75906-e1ed-4382-9ea8-0d933ab545ca" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.215104] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-74c75906-e1ed-4382-9ea8-0d933ab545ca" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.215303] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74c75906-e1ed-4382-9ea8-0d933ab545ca',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.320654] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 in Status: SUCCESS [ 1079.320809] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 deletion is rescheduled due to dependency. [ 1079.320905] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.321094] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.321382] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.321580] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.321701] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.321777] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.321987] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.322092] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.322213] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56646d46-eb79-4ebc-a596-a5a17716f8e4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.406976] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.406976] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.406976] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.406976] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.406976] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.406976] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.406976] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.406976] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.407382] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.407382] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.407382] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 433d7528-b29b-4b58-848d-9e981ea88344 already deleted. [ 1079.407476] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-433d7528-b29b-4b58-848d-9e981ea88344" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.505552] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5213eca1-1629-4d3e-93bd-0ade688f6269 [ 1079.505803] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.505936] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.506012] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.506413] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.506618] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.506726] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5213eca1-1629-4d3e-93bd-0ade688f6269 already deleted. [ 1079.506834] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5213eca1-1629-4d3e-93bd-0ade688f6269" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.718097] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.718312] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.718426] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.718714] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.718862] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.719024] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 74c75906-e1ed-4382-9ea8-0d933ab545ca not found, creating... [ 1079.719290] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.719451] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.719567] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.719784] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.719919] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.721599] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.721599] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.721599] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.721599] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.721599] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.721599] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 74c75906-e1ed-4382-9ea8-0d933ab545ca is going to be created. [ 1079.741824] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.741954] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.742038] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.742328] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.742566] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.742803] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-74c75906-e1ed-4382-9ea8-0d933ab545ca" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.827163] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('56646d46-eb79-4ebc-a596-a5a17716f8e4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.330307] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('56646d46-eb79-4ebc-a596-a5a17716f8e4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.397467] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3379805b-13ae-4057-9511-570e8b3c2437 in Status: SUCCESS [ 1080.397675] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.397833] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.398070] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.398257] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.398365] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.398429] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.398602] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.398679] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.398764] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.398852] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3379805b-13ae-4057-9511-570e8b3c2437',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.440691] env[70764]: INFO networking_nsxv3.common.synchronization [req-ccfc6d46-2a48-4340-a427-dfbc72b866d1 req-ee21285d-6cae-4b7d-8587-0e095281b1fe service nova] Enqueued Resource ID: 433d7528-b29b-4b58-848d-9e981ea88344 with Priority: HIGHEST for action security_group_rules [ 1080.440904] env[70764]: INFO networking_nsxv3.common.synchronization [req-ccfc6d46-2a48-4340-a427-dfbc72b866d1 req-ee21285d-6cae-4b7d-8587-0e095281b1fe service nova] Enqueued Resource ID: 433d7528-b29b-4b58-848d-9e981ea88344 with Priority: HIGHEST for action security_group_members [ 1080.442286] env[70764]: INFO networking_nsxv3.common.synchronization [req-ccfc6d46-2a48-4340-a427-dfbc72b866d1 req-ee21285d-6cae-4b7d-8587-0e095281b1fe service nova] Enqueued Resource ID: 74c75906-e1ed-4382-9ea8-0d933ab545ca with Priority: HIGHEST for action port [ 1080.442436] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 433d7528-b29b-4b58-848d-9e981ea88344 with Priority: HIGHEST for action security_group_rules [ 1080.442561] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 433d7528-b29b-4b58-848d-9e981ea88344 with Priority: HIGHEST for action security_group_members [ 1080.442693] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74c75906-e1ed-4382-9ea8-0d933ab545ca with Priority: HIGHEST for action port [ 1080.443499] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-433d7528-b29b-4b58-848d-9e981ea88344 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.443499] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-433d7528-b29b-4b58-848d-9e981ea88344" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.443499] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-433d7528-b29b-4b58-848d-9e981ea88344" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.443875] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-433d7528-b29b-4b58-848d-9e981ea88344" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.443875] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('433d7528-b29b-4b58-848d-9e981ea88344',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.444857] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-433d7528-b29b-4b58-848d-9e981ea88344 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.444857] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-433d7528-b29b-4b58-848d-9e981ea88344" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.444857] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-433d7528-b29b-4b58-848d-9e981ea88344" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.445014] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-433d7528-b29b-4b58-848d-9e981ea88344" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.445155] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.445362] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.445362] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.447225] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.447225] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.447225] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('433d7528-b29b-4b58-848d-9e981ea88344',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.447225] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-74c75906-e1ed-4382-9ea8-0d933ab545ca taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.447225] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74c75906-e1ed-4382-9ea8-0d933ab545ca" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.447225] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74c75906-e1ed-4382-9ea8-0d933ab545ca" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.447225] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74c75906-e1ed-4382-9ea8-0d933ab545ca" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.447225] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74c75906-e1ed-4382-9ea8-0d933ab545ca',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.833455] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.833626] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.833689] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.833981] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.834043] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.834103] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 is going to be updated. [ 1080.860625] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.860788] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.860865] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.861267] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.861267] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.869582] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 in Status: IN_PROGRESS for 2s [ 1080.901783] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-3379805b-13ae-4057-9511-570e8b3c2437 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.901969] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.902067] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.902349] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.902537] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.902667] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.902730] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.902897] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.902984] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.903120] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.903306] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-3379805b-13ae-4057-9511-570e8b3c2437 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.903397] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.903455] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.903601] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.903764] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.903867] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.903928] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.904111] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.904228] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.904350] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.904468] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3379805b-13ae-4057-9511-570e8b3c2437',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.949164] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-433d7528-b29b-4b58-848d-9e981ea88344 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.949309] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-433d7528-b29b-4b58-848d-9e981ea88344" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.949485] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('433d7528-b29b-4b58-848d-9e981ea88344',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.950602] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 74c75906-e1ed-4382-9ea8-0d933ab545ca with status ACTIVE [ 1080.950790] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.950908] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.950964] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.955577] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.956501] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.956501] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.956501] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.958182] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.958416] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.958503] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.959097] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.959577] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.959577] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.959577] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.959577] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.959725] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 74c75906-e1ed-4382-9ea8-0d933ab545ca is going to be updated. [ 1080.984155] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.984309] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.984380] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.985412] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.985603] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.985773] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74c75906-e1ed-4382-9ea8-0d933ab545ca" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.407189] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3379805b-13ae-4057-9511-570e8b3c2437: rpc.has_security_group_logging(os_id): False [ 1081.424431] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.424575] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.424575] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.424777] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.424891] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.425128] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.425230] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.425295] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.425457] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.425528] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.425704] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.425798] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.425858] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.425994] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.426081] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.426269] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.426353] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.426413] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.426779] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.426779] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.426779] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3379805b-13ae-4057-9511-570e8b3c2437 is going to be updated. [ 1081.461871] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('433d7528-b29b-4b58-848d-9e981ea88344',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.482736] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.482736] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.482736] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.482736] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.482736] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.494794] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3379805b-13ae-4057-9511-570e8b3c2437 in Status: IN_PROGRESS for 2s [ 1081.968469] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.968698] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.968698] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.968932] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.969044] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.969150] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 433d7528-b29b-4b58-848d-9e981ea88344 is going to be created. [ 1081.993462] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.993641] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.993641] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.993895] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.994100] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.004889] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 433d7528-b29b-4b58-848d-9e981ea88344 in Status: UNINITIALIZED for 2s [ 1082.879750] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 in Status: SUCCESS [ 1082.879750] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.880058] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.880135] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.880331] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.880473] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.880539] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.880695] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.880771] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.880875] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.880965] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('56646d46-eb79-4ebc-a596-a5a17716f8e4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.084581] env[70764]: INFO networking_nsxv3.common.synchronization [req-e04d3e32-bc14-43d2-a220-ef1426521360 req-f4d4ee99-5bc3-46f7-8af1-d830c27ea6a1 tempest-ServersTestJSON-88830314 tempest-ServersTestJSON-88830314-project-member] Enqueued Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_members [ 1083.084581] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_members [ 1083.084581] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.084581] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.085043] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.085512] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.085683] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.085793] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.085876] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.086072] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.086165] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.086265] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.219580] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.219765] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.219808] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.220062] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.220191] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.376759] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-603 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.376978] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-603" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.377120] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-603" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.377394] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-603" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.377658] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.377816] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.377934] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.378175] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.378322] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.378528] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1083.378641] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1083.378750] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1083.378860] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1083.378970] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1083.379087] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1083.379346] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1083.383533] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-56646d46-eb79-4ebc-a596-a5a17716f8e4 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.383675] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.383747] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.383908] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.384069] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.384172] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.384242] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.384391] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.384478] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.384567] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.384735] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-56646d46-eb79-4ebc-a596-a5a17716f8e4 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.384832] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.384906] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.385063] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.385205] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.385305] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.385366] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.385633] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.385633] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.385734] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.385774] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('56646d46-eb79-4ebc-a596-a5a17716f8e4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.396710] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1083.396896] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1083.397049] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1083.397230] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-603" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.397540] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-da41d828-4014-4b1e-9839-926dda6b7cb6 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.397711] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-da41d828-4014-4b1e-9839-926dda6b7cb6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.397833] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-da41d828-4014-4b1e-9839-926dda6b7cb6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.398160] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-da41d828-4014-4b1e-9839-926dda6b7cb6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.398328] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da41d828-4014-4b1e-9839-926dda6b7cb6',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.508493] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3379805b-13ae-4057-9511-570e8b3c2437 in Status: SUCCESS [ 1083.508749] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.588670] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.722348] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.831317] env[70764]: INFO networking_nsxv3.common.synchronization [req-c219abd2-85c1-42d9-a99b-4e5349bb3699 req-e99aa16c-a540-4877-9403-cb5d4c6d2de4 tempest-FloatingIPsAssociationTestJSON-699796548 tempest-FloatingIPsAssociationTestJSON-699796548-project-member] Enqueued Resource ID: 390854ae-4528-43fa-8fd3-61a4742be55a with Priority: HIGHEST for action security_group_members [ 1083.831927] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 390854ae-4528-43fa-8fd3-61a4742be55a with Priority: HIGHEST for action security_group_members [ 1083.832258] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-390854ae-4528-43fa-8fd3-61a4742be55a taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.832397] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.832481] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.832684] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.832865] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.832967] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.833148] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.833648] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.833648] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.833648] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('390854ae-4528-43fa-8fd3-61a4742be55a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.887478] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 56646d46-eb79-4ebc-a596-a5a17716f8e4: rpc.has_security_group_logging(os_id): False [ 1083.900473] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.900715] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.900833] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.901227] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.901387] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.901565] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port da41d828-4014-4b1e-9839-926dda6b7cb6 not found, creating... [ 1083.902296] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.902296] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.902296] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.902506] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.902614] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.903207] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.903325] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.903429] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.903665] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.903811] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.903956] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: da41d828-4014-4b1e-9839-926dda6b7cb6 is going to be created. [ 1083.905803] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.905926] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.905979] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.906172] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.906578] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.906578] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.906578] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.906578] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.906762] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.906862] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.907011] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.907105] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.907162] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.907304] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.907393] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.907586] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.907688] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.907750] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.907884] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.907958] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.908070] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 is going to be updated. [ 1083.936799] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.937026] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.937179] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.937473] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.937738] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.937976] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-da41d828-4014-4b1e-9839-926dda6b7cb6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.972883] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.972883] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.972883] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.973112] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.973326] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.986806] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 in Status: IN_PROGRESS for 2s [ 1084.015857] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 433d7528-b29b-4b58-848d-9e981ea88344 in Status: SUCCESS [ 1084.016126] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-433d7528-b29b-4b58-848d-9e981ea88344" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.016295] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-433d7528-b29b-4b58-848d-9e981ea88344" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.016556] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-433d7528-b29b-4b58-848d-9e981ea88344" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.016791] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.016944] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.017042] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.017249] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.017359] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.017471] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-433d7528-b29b-4b58-848d-9e981ea88344" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.017586] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('433d7528-b29b-4b58-848d-9e981ea88344',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.090582] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.226103] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.338541] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.338762] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.338896] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.339144] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.339265] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.339524] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.339748] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.339748] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.339879] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.339976] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.340116] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 390854ae-4528-43fa-8fd3-61a4742be55a is going to be updated. [ 1084.366324] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.366493] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.366600] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.366935] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.367133] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.375248] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 390854ae-4528-43fa-8fd3-61a4742be55a in Status: IN_PROGRESS for 2s [ 1084.520477] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('433d7528-b29b-4b58-848d-9e981ea88344',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.594279] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.594279] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.594567] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.594609] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.594682] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.594787] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8f5efec-a14e-4be6-8add-7b35a995c982 is going to be updated. [ 1084.632863] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.633040] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.633122] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.633777] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.633935] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.649937] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: IN_PROGRESS for 2s [ 1084.703012] env[70764]: INFO networking_nsxv3.common.synchronization [req-e04d3e32-bc14-43d2-a220-ef1426521360 req-91f35181-e6ec-4f93-8583-a309353661b9 service nova] Enqueued Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_rules [ 1084.703012] env[70764]: INFO networking_nsxv3.common.synchronization [req-e04d3e32-bc14-43d2-a220-ef1426521360 req-91f35181-e6ec-4f93-8583-a309353661b9 service nova] Enqueued Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_members [ 1084.703012] env[70764]: INFO networking_nsxv3.common.synchronization [req-e04d3e32-bc14-43d2-a220-ef1426521360 req-91f35181-e6ec-4f93-8583-a309353661b9 service nova] Enqueued Resource ID: da41d828-4014-4b1e-9839-926dda6b7cb6 with Priority: HIGHEST for action port [ 1084.703012] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_rules [ 1084.703906] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_members [ 1084.704060] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da41d828-4014-4b1e-9839-926dda6b7cb6 with Priority: HIGHEST for action port [ 1084.704424] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.704550] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.704618] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.704823] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.704906] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.707371] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.707371] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.707371] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-da41d828-4014-4b1e-9839-926dda6b7cb6 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.707371] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da41d828-4014-4b1e-9839-926dda6b7cb6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.707371] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da41d828-4014-4b1e-9839-926dda6b7cb6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.707371] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da41d828-4014-4b1e-9839-926dda6b7cb6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.707371] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da41d828-4014-4b1e-9839-926dda6b7cb6',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.728115] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1084.728419] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1085.022533] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 433d7528-b29b-4b58-848d-9e981ea88344: rpc.has_security_group_logging(os_id): False [ 1085.202249] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.202424] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.202424] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.202624] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.202719] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.202970] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.203090] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.203154] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.203347] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.203424] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.203513] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 433d7528-b29b-4b58-848d-9e981ea88344 is going to be created. [ 1085.210499] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.210869] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.210869] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port da41d828-4014-4b1e-9839-926dda6b7cb6 with status ACTIVE [ 1085.211079] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.211239] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.211325] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.211565] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.211705] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.211911] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.212051] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.212135] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.212334] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.212435] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.212647] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.212764] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.212844] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.213041] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.213138] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.213283] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: da41d828-4014-4b1e-9839-926dda6b7cb6 is going to be updated. [ 1085.268618] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.268810] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.268857] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.269285] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.269285] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.269383] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da41d828-4014-4b1e-9839-926dda6b7cb6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.324430] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.324606] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.325170] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.325449] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.325640] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.380342] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 433d7528-b29b-4b58-848d-9e981ea88344 in Status: IN_PROGRESS for 2s [ 1085.409142] env[70764]: INFO networking_nsxv3.common.synchronization [req-1703faa8-96eb-4695-8dc3-13cf85a95ae7 req-b30b7038-e987-41ae-be41-0af869d64676 tempest-ImagesNegativeTestJSON-987179543 tempest-ImagesNegativeTestJSON-987179543-project-member] Enqueued Resource ID: fa4fd6a5-5b80-4a63-9124-bbb06edc03a7 with Priority: HIGHEST for action security_group_members [ 1085.410738] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa4fd6a5-5b80-4a63-9124-bbb06edc03a7 with Priority: HIGHEST for action security_group_members [ 1085.410738] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa4fd6a5-5b80-4a63-9124-bbb06edc03a7 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.410738] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa4fd6a5-5b80-4a63-9124-bbb06edc03a7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.410738] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa4fd6a5-5b80-4a63-9124-bbb06edc03a7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.410738] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa4fd6a5-5b80-4a63-9124-bbb06edc03a7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.410738] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.410738] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.410738] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.411067] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.411067] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.411170] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa4fd6a5-5b80-4a63-9124-bbb06edc03a7',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.772070] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-894 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.772387] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-894" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.772499] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-894" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.772838] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-894" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.773151] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.773397] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.773538] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.773924] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.773924] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.774164] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1085.774306] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1085.774425] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1085.774539] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1085.774658] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1085.774772] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1085.774909] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1085.797543] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1085.797728] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1085.797869] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1085.798065] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-894" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.798393] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-b2d60ded-db8f-471f-86d0-33a10082bcb8 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.798569] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-b2d60ded-db8f-471f-86d0-33a10082bcb8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.798689] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-b2d60ded-db8f-471f-86d0-33a10082bcb8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.799023] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-b2d60ded-db8f-471f-86d0-33a10082bcb8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.799167] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2d60ded-db8f-471f-86d0-33a10082bcb8',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.857639] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.857816] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.857887] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.858125] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.872042] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1085.873022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.874466] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1085.905080] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.905278] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.905362] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.905583] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.915838] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.916711] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1085.916804] env[70764]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=70764) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1085.916901] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1085.918575] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.918750] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.918819] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.919455] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.919455] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.919455] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.919584] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.919616] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.919793] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.919912] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.920158] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa4fd6a5-5b80-4a63-9124-bbb06edc03a7 already deleted. [ 1085.920158] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa4fd6a5-5b80-4a63-9124-bbb06edc03a7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.958202] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.958315] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.958435] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.958727] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.960629] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.960901] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1086.001356] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 in Status: SUCCESS [ 1086.001356] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.035782] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.035782] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.035782] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.036259] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.036259] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.036456] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1086.117092] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.117259] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.117297] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.117537] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.117838] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.118174] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:46. [ 1086.118283] env[70764]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'1e8d083b-4d4e-4192-8c53-ff33df47b5e7', '837be310-7b7c-4ed0-9877-3473fe63d929', '5e9c0048-237b-4cab-86e0-e56dce546daa', 'b9410f01-20de-42de-8117-bdf11cf59643', '380030c5-e260-46fb-aa7e-5000c5bc9507', '2a93825c-656b-4f3f-b946-3346edd746bf', 'f8f5efec-a14e-4be6-8add-7b35a995c982', '5ec7f171-db73-4bef-97dc-92782231e84b', '3cd125ff-382e-4eec-ae57-a26a30a63320', 'b221064c-6962-44ea-989e-cf4546ea92ab', '9c661804-19d8-4b01-b7d8-b4d1885cc85f', '9e245eb8-32e9-4599-974c-039ad69ab827', '0e0a8aca-d575-4597-b049-0d3d263dac47', 'e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b', '46c016e6-244a-4247-9a9f-a7b0e21f0989', 'ffefe95f-97fb-4dd1-96fc-f444084d7691', '1f7d8ca5-61df-4ea2-b964-843e08d1b082', '4e505537-e930-46b3-bee1-b6cba5260d3d', '4402a532-4a5c-4a18-993a-a6249c552031', '1575c38c-2999-4e79-86e3-5e41e8eaa04a', '7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3', '3379805b-13ae-4057-9511-570e8b3c2437', '4c1c605b-e422-421f-b86e-88a41bb1f9f4', 'b8fbd205-3cf1-4080-a3d7-9b99aeb35f70', 'bdd0180d-c388-4ba4-a117-13e93e3b0327', '2fc2deb2-a89e-4527-9c6b-7c33727bc09c', 'c0695687-32e8-4e4a-a8c8-31e6c3709596', 'b963e01f-1537-47b8-8841-14ab14f97bf8', '10a6cc00-1953-4c0f-8a12-c0405294ba0f', '390854ae-4528-43fa-8fd3-61a4742be55a', '6e903658-277d-417d-95d4-4fcc19078cba', '18c40e3b-51cd-431a-858a-22168889b4fd', '82966c1e-4055-4b82-8cb6-2f08a28fcec0', '4580d502-1d18-4681-96a4-28ac4e291d69', '7a2d7e17-bca4-4474-a2c6-152a257dcccd', '46f17c96-2a3a-415a-8b88-fe6fa64e3db5', 'a9995ac6-c7bb-4911-9b05-92ca94f2c030', 'f9c2bf07-cd28-4135-994d-30a9140bcc35', '56646d46-eb79-4ebc-a596-a5a17716f8e4', '527aa039-9b45-4682-bffb-ac71e24551a1', '025fa550-df80-4c1b-a8f7-f75221e3bef7', 'fc0ae2a8-a235-4d05-9f57-5fec83d37151', '4bfe698a-a7e8-4922-85ee-f21b719b7edb', '433d7528-b29b-4b58-848d-9e981ea88344', '37e71aae-75a3-4784-89f9-86f606e096a1', 'dffe2468-a89e-4c09-9b45-a73f1d41f82e'} {{(pid=70764) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1086.118408] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1086.138863] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.139056] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.139219] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.139562] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.139740] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.139954] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1086.140131] env[70764]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=70764) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1086.140395] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1086.237883] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.238146] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.238146] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.238374] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.239373] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.239620] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1086.239695] env[70764]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70764) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1086.239767] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1086.239835] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1086.239913] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/46 resources of Type:Security Group Rules [ 1086.239997] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1e8d083b-4d4e-4192-8c53-ff33df47b5e7 with Priority: HIGH for action security_group_rules [ 1086.240104] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 837be310-7b7c-4ed0-9877-3473fe63d929 with Priority: HIGH for action security_group_rules [ 1086.240157] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5e9c0048-237b-4cab-86e0-e56dce546daa with Priority: HIGH for action security_group_rules [ 1086.240235] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b9410f01-20de-42de-8117-bdf11cf59643 with Priority: HIGH for action security_group_rules [ 1086.240301] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 with Priority: HIGH for action security_group_rules [ 1086.240383] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2a93825c-656b-4f3f-b946-3346edd746bf with Priority: HIGH for action security_group_rules [ 1086.240450] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGH for action security_group_rules [ 1086.240526] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5ec7f171-db73-4bef-97dc-92782231e84b with Priority: HIGH for action security_group_rules [ 1086.240590] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3cd125ff-382e-4eec-ae57-a26a30a63320 with Priority: HIGH for action security_group_rules [ 1086.240647] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b221064c-6962-44ea-989e-cf4546ea92ab with Priority: HIGH for action security_group_rules [ 1086.240722] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9c661804-19d8-4b01-b7d8-b4d1885cc85f with Priority: HIGH for action security_group_rules [ 1086.240777] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9e245eb8-32e9-4599-974c-039ad69ab827 with Priority: HIGH for action security_group_rules [ 1086.240836] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0e0a8aca-d575-4597-b049-0d3d263dac47 with Priority: HIGH for action security_group_rules [ 1086.240911] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b with Priority: HIGH for action security_group_rules [ 1086.240974] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 46c016e6-244a-4247-9a9f-a7b0e21f0989 with Priority: HIGH for action security_group_rules [ 1086.241068] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ffefe95f-97fb-4dd1-96fc-f444084d7691 with Priority: HIGH for action security_group_rules [ 1086.241164] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1f7d8ca5-61df-4ea2-b964-843e08d1b082 with Priority: HIGH for action security_group_rules [ 1086.241277] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4e505537-e930-46b3-bee1-b6cba5260d3d with Priority: HIGH for action security_group_rules [ 1086.241412] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4402a532-4a5c-4a18-993a-a6249c552031 with Priority: HIGH for action security_group_rules [ 1086.241412] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1575c38c-2999-4e79-86e3-5e41e8eaa04a with Priority: HIGH for action security_group_rules [ 1086.241537] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.305178] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.305429] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.305567] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.305855] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.306022] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.306277] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port b2d60ded-db8f-471f-86d0-33a10082bcb8 not found, creating... [ 1086.306453] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.306611] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.306729] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.306946] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.307097] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.307380] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.307645] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.307783] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.307859] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.307989] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.308180] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: b2d60ded-db8f-471f-86d0-33a10082bcb8 is going to be created. [ 1086.334801] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.335056] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.335207] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.335516] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.335800] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.336072] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-b2d60ded-db8f-471f-86d0-33a10082bcb8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.384555] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 390854ae-4528-43fa-8fd3-61a4742be55a in Status: SUCCESS [ 1086.384721] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 390854ae-4528-43fa-8fd3-61a4742be55a deletion is rescheduled due to dependency. [ 1086.384798] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-390854ae-4528-43fa-8fd3-61a4742be55a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.668213] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: SUCCESS [ 1086.668488] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.668718] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.668952] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.669181] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.669328] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.669408] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.669586] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.669668] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.669789] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.943959] env[70764]: INFO networking_nsxv3.common.synchronization [req-4052d5d1-741b-4b87-b971-ea1860b3e198 req-002232ca-78b0-4bd5-95be-fc34906cae3e tempest-DeleteServersTestJSON-1788501793 tempest-DeleteServersTestJSON-1788501793-project-member] Enqueued Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGHEST for action security_group_members [ 1086.945019] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGHEST for action security_group_members [ 1086.945019] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e8d083b-4d4e-4192-8c53-ff33df47b5e7 with Priority: HIGH for action security_group_rules [ 1086.945019] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e9c0048-237b-4cab-86e0-e56dce546daa with Priority: HIGH for action security_group_rules [ 1086.945019] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGH for action security_group_rules [ 1086.945019] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46c016e6-244a-4247-9a9f-a7b0e21f0989 with Priority: HIGH for action security_group_rules [ 1086.945485] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1575c38c-2999-4e79-86e3-5e41e8eaa04a with Priority: HIGH for action security_group_rules [ 1086.945630] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4402a532-4a5c-4a18-993a-a6249c552031 with Priority: HIGH for action security_group_rules [ 1086.945719] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e505537-e930-46b3-bee1-b6cba5260d3d with Priority: HIGH for action security_group_rules [ 1086.945818] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f7d8ca5-61df-4ea2-b964-843e08d1b082 with Priority: HIGH for action security_group_rules [ 1086.945898] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b with Priority: HIGH for action security_group_rules [ 1086.945985] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffefe95f-97fb-4dd1-96fc-f444084d7691 with Priority: HIGH for action security_group_rules [ 1086.946145] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e0a8aca-d575-4597-b049-0d3d263dac47 with Priority: HIGH for action security_group_rules [ 1086.946256] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e245eb8-32e9-4599-974c-039ad69ab827 with Priority: HIGH for action security_group_rules [ 1086.946349] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c661804-19d8-4b01-b7d8-b4d1885cc85f with Priority: HIGH for action security_group_rules [ 1086.946439] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b221064c-6962-44ea-989e-cf4546ea92ab with Priority: HIGH for action security_group_rules [ 1086.946530] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cd125ff-382e-4eec-ae57-a26a30a63320 with Priority: HIGH for action security_group_rules [ 1086.946616] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a93825c-656b-4f3f-b946-3346edd746bf with Priority: HIGH for action security_group_rules [ 1086.946719] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ec7f171-db73-4bef-97dc-92782231e84b with Priority: HIGH for action security_group_rules [ 1086.946806] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 with Priority: HIGH for action security_group_rules [ 1086.946910] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 837be310-7b7c-4ed0-9877-3473fe63d929 with Priority: HIGH for action security_group_rules [ 1086.947036] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9410f01-20de-42de-8117-bdf11cf59643 with Priority: HIGH for action security_group_rules [ 1086.947374] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-3379805b-13ae-4057-9511-570e8b3c2437 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.947487] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.947596] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.947814] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.947975] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.948095] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.948194] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.948354] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.948471] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.948576] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3379805b-13ae-4057-9511-570e8b3c2437',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.949600] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e8d083b-4d4e-4192-8c53-ff33df47b5e7 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.949722] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e8d083b-4d4e-4192-8c53-ff33df47b5e7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.949789] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e8d083b-4d4e-4192-8c53-ff33df47b5e7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.949987] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e8d083b-4d4e-4192-8c53-ff33df47b5e7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.950104] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e8d083b-4d4e-4192-8c53-ff33df47b5e7',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.951046] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e9c0048-237b-4cab-86e0-e56dce546daa taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.951181] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.951266] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.951465] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.951553] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e9c0048-237b-4cab-86e0-e56dce546daa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.952403] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.952516] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.952735] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46c016e6-244a-4247-9a9f-a7b0e21f0989 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.952944] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46c016e6-244a-4247-9a9f-a7b0e21f0989" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.952944] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46c016e6-244a-4247-9a9f-a7b0e21f0989" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.953128] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46c016e6-244a-4247-9a9f-a7b0e21f0989" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.953206] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46c016e6-244a-4247-9a9f-a7b0e21f0989',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.954176] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1575c38c-2999-4e79-86e3-5e41e8eaa04a taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.954273] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1575c38c-2999-4e79-86e3-5e41e8eaa04a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.954346] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1575c38c-2999-4e79-86e3-5e41e8eaa04a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.954502] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1575c38c-2999-4e79-86e3-5e41e8eaa04a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.954597] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1575c38c-2999-4e79-86e3-5e41e8eaa04a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.955386] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4402a532-4a5c-4a18-993a-a6249c552031 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.955499] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4402a532-4a5c-4a18-993a-a6249c552031" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.955572] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4402a532-4a5c-4a18-993a-a6249c552031" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.955752] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4402a532-4a5c-4a18-993a-a6249c552031" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.955828] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4402a532-4a5c-4a18-993a-a6249c552031',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.957132] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e505537-e930-46b3-bee1-b6cba5260d3d taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.957266] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.957328] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.957512] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.957589] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e505537-e930-46b3-bee1-b6cba5260d3d',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.958483] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f7d8ca5-61df-4ea2-b964-843e08d1b082 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.958539] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.958641] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.958835] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.958941] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f7d8ca5-61df-4ea2-b964-843e08d1b082',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.962178] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.962419] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.962494] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.962674] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.962754] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.963614] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ffefe95f-97fb-4dd1-96fc-f444084d7691 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.963721] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.963790] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.963952] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.964049] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ffefe95f-97fb-4dd1-96fc-f444084d7691',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.964884] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e0a8aca-d575-4597-b049-0d3d263dac47 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.965035] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e0a8aca-d575-4597-b049-0d3d263dac47" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.965150] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e0a8aca-d575-4597-b049-0d3d263dac47" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.965248] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e0a8aca-d575-4597-b049-0d3d263dac47" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.965322] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e0a8aca-d575-4597-b049-0d3d263dac47',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.966036] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e245eb8-32e9-4599-974c-039ad69ab827 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.966154] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.966220] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.966366] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.966449] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e245eb8-32e9-4599-974c-039ad69ab827',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.967511] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c661804-19d8-4b01-b7d8-b4d1885cc85f taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.967623] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.967692] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.967899] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.967929] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c661804-19d8-4b01-b7d8-b4d1885cc85f',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.969142] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b221064c-6962-44ea-989e-cf4546ea92ab taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.969142] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b221064c-6962-44ea-989e-cf4546ea92ab" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.969142] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b221064c-6962-44ea-989e-cf4546ea92ab" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.969142] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b221064c-6962-44ea-989e-cf4546ea92ab" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.969142] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b221064c-6962-44ea-989e-cf4546ea92ab',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.969780] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3cd125ff-382e-4eec-ae57-a26a30a63320 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.969869] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3cd125ff-382e-4eec-ae57-a26a30a63320" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.969938] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3cd125ff-382e-4eec-ae57-a26a30a63320" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.970151] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3cd125ff-382e-4eec-ae57-a26a30a63320" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.970232] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3cd125ff-382e-4eec-ae57-a26a30a63320',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.971087] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a93825c-656b-4f3f-b946-3346edd746bf taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.971231] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.971287] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.971440] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.971536] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a93825c-656b-4f3f-b946-3346edd746bf',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.972441] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5ec7f171-db73-4bef-97dc-92782231e84b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.972504] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5ec7f171-db73-4bef-97dc-92782231e84b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.972684] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5ec7f171-db73-4bef-97dc-92782231e84b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.972738] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5ec7f171-db73-4bef-97dc-92782231e84b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.972821] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5ec7f171-db73-4bef-97dc-92782231e84b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.977283] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-380030c5-e260-46fb-aa7e-5000c5bc9507 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.977424] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.977493] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.977669] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.977751] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('380030c5-e260-46fb-aa7e-5000c5bc9507',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.978836] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-837be310-7b7c-4ed0-9877-3473fe63d929 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.978956] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-837be310-7b7c-4ed0-9877-3473fe63d929" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.979040] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-837be310-7b7c-4ed0-9877-3473fe63d929" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.979208] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-837be310-7b7c-4ed0-9877-3473fe63d929" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.979587] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('837be310-7b7c-4ed0-9877-3473fe63d929',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.980634] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b9410f01-20de-42de-8117-bdf11cf59643 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.980634] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b9410f01-20de-42de-8117-bdf11cf59643" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.980634] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b9410f01-20de-42de-8117-bdf11cf59643" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.980794] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b9410f01-20de-42de-8117-bdf11cf59643" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.980872] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b9410f01-20de-42de-8117-bdf11cf59643',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.011636] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.011820] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.011867] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.012108] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.032435] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.032569] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e8d083b-4d4e-4192-8c53-ff33df47b5e7 is going to be deleted. [ 1087.073955] env[70764]: INFO networking_nsxv3.common.synchronization [req-1703faa8-96eb-4695-8dc3-13cf85a95ae7 req-e8171891-0014-4b51-9fa6-4a6ee888b3ac service nova] Enqueued Resource ID: fa4fd6a5-5b80-4a63-9124-bbb06edc03a7 with Priority: HIGHEST for action security_group_rules [ 1087.074222] env[70764]: INFO networking_nsxv3.common.synchronization [req-1703faa8-96eb-4695-8dc3-13cf85a95ae7 req-e8171891-0014-4b51-9fa6-4a6ee888b3ac service nova] Enqueued Resource ID: fa4fd6a5-5b80-4a63-9124-bbb06edc03a7 with Priority: HIGHEST for action security_group_members [ 1087.074222] env[70764]: INFO networking_nsxv3.common.synchronization [req-1703faa8-96eb-4695-8dc3-13cf85a95ae7 req-e8171891-0014-4b51-9fa6-4a6ee888b3ac service nova] Enqueued Resource ID: b2d60ded-db8f-471f-86d0-33a10082bcb8 with Priority: HIGHEST for action port [ 1087.075623] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa4fd6a5-5b80-4a63-9124-bbb06edc03a7 with Priority: HIGHEST for action security_group_rules [ 1087.075623] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa4fd6a5-5b80-4a63-9124-bbb06edc03a7 with Priority: HIGHEST for action security_group_members [ 1087.075623] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2d60ded-db8f-471f-86d0-33a10082bcb8 with Priority: HIGHEST for action port [ 1087.075861] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fa4fd6a5-5b80-4a63-9124-bbb06edc03a7 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.075967] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fa4fd6a5-5b80-4a63-9124-bbb06edc03a7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.076166] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fa4fd6a5-5b80-4a63-9124-bbb06edc03a7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.076333] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fa4fd6a5-5b80-4a63-9124-bbb06edc03a7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.076421] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fa4fd6a5-5b80-4a63-9124-bbb06edc03a7',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.077713] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa4fd6a5-5b80-4a63-9124-bbb06edc03a7 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.078119] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa4fd6a5-5b80-4a63-9124-bbb06edc03a7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.078119] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa4fd6a5-5b80-4a63-9124-bbb06edc03a7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.078277] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa4fd6a5-5b80-4a63-9124-bbb06edc03a7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.078726] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.078834] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.078995] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.079118] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.079195] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.079285] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa4fd6a5-5b80-4a63-9124-bbb06edc03a7',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.080388] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2d60ded-db8f-471f-86d0-33a10082bcb8 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.080604] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2d60ded-db8f-471f-86d0-33a10082bcb8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.080604] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2d60ded-db8f-471f-86d0-33a10082bcb8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.080759] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2d60ded-db8f-471f-86d0-33a10082bcb8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.080855] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2d60ded-db8f-471f-86d0-33a10082bcb8',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.082870] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.083051] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.083161] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.083307] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.083418] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.084421] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e8d083b-4d4e-4192-8c53-ff33df47b5e7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.173049] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.391906] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 433d7528-b29b-4b58-848d-9e981ea88344 in Status: SUCCESS [ 1087.392189] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-433d7528-b29b-4b58-848d-9e981ea88344" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.475525] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.475671] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.475767] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.475991] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.483823] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-46c016e6-244a-4247-9a9f-a7b0e21f0989 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.483943] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46c016e6-244a-4247-9a9f-a7b0e21f0989" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.483978] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46c016e6-244a-4247-9a9f-a7b0e21f0989" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.484197] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46c016e6-244a-4247-9a9f-a7b0e21f0989" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.484418] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.484511] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.484569] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.484722] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.484835] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.485036] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46c016e6-244a-4247-9a9f-a7b0e21f0989" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.485036] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('46c016e6-244a-4247-9a9f-a7b0e21f0989',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.488010] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.488132] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.488198] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.488390] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.488564] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.489704] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.489704] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.489704] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.489704] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.489704] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.489704] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.495252] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e505537-e930-46b3-bee1-b6cba5260d3d taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.495432] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.495514] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.495738] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.495893] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.497028] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.497028] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.497028] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.497028] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.497028] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.497028] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4e505537-e930-46b3-bee1-b6cba5260d3d',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.497265] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.497394] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.512871] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.513014] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4402a532-4a5c-4a18-993a-a6249c552031 is going to be deleted. [ 1087.514162] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4e505537-e930-46b3-bee1-b6cba5260d3d',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.518068] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.518323] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.536646] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.536763] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.550168] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.550282] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.551166] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.551284] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.554641] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.554773] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.558174] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.558174] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.558689] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.558816] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.559482] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.559571] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.560275] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.560361] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.561140] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.561252] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.561937] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.562047] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.564627] env[70764]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1087.565108] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.565206] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.565780] env[70764]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1087.566209] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.566294] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.566960] env[70764]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1087.567357] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.567456] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.568058] env[70764]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1087.568449] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.568599] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.569251] env[70764]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1087.569657] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.569893] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.570018] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.570084] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.570277] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.570360] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.570449] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3379805b-13ae-4057-9511-570e8b3c2437 is going to be updated. [ 1087.571360] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.571534] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.585985] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa4fd6a5-5b80-4a63-9124-bbb06edc03a7 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.585985] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa4fd6a5-5b80-4a63-9124-bbb06edc03a7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.585985] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fa4fd6a5-5b80-4a63-9124-bbb06edc03a7',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.586636] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b2d60ded-db8f-471f-86d0-33a10082bcb8 with status ACTIVE [ 1087.586824] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.586987] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.587083] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.587284] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.587364] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.587554] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.587649] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.587707] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.587846] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.589019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.589019] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.589019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.589019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.589019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.589019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.589019] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b2d60ded-db8f-471f-86d0-33a10082bcb8 is going to be updated. [ 1087.590441] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.590441] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1575c38c-2999-4e79-86e3-5e41e8eaa04a is going to be deleted. [ 1087.591357] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.591517] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.599010] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.599147] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.602124] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.602236] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.602236] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.602421] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.602555] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.610166] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.610166] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e0a8aca-d575-4597-b049-0d3d263dac47 is going to be deleted. [ 1087.610166] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.610166] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.611883] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3379805b-13ae-4057-9511-570e8b3c2437 in Status: IN_PROGRESS for 2s [ 1087.612581] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.612743] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.612836] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.612938] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.613068] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.614324] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2d60ded-db8f-471f-86d0-33a10082bcb8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.629287] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.629425] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3cd125ff-382e-4eec-ae57-a26a30a63320 is going to be deleted. [ 1087.630281] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.630475] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.674212] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.674337] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.675714] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.686065] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.686065] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b221064c-6962-44ea-989e-cf4546ea92ab is going to be deleted. [ 1087.686710] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.687027] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.701175] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.701175] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.720381] env[70764]: INFO networking_nsxv3.common.synchronization [req-babc11e3-c299-4a70-ae8b-6c584a6d76bb req-7d4b5ae3-227b-4cd9-a70a-06750c903c66 tempest-ServersNegativeTestJSON-791332416 tempest-ServersNegativeTestJSON-791332416-project-member] Enqueued Resource ID: 01588700-3c33-4723-87f1-c5abc176445e with Priority: HIGHEST for action security_group_members [ 1087.721093] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01588700-3c33-4723-87f1-c5abc176445e with Priority: HIGHEST for action security_group_members [ 1087.721931] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-01588700-3c33-4723-87f1-c5abc176445e taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.721931] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.721931] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.721931] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.722200] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.722327] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.722413] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.722601] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.722714] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.722831] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01588700-3c33-4723-87f1-c5abc176445e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.735632] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.735747] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5ec7f171-db73-4bef-97dc-92782231e84b is going to be deleted. [ 1087.737074] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.737326] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.763600] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.763752] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.827598] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.827747] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e9c0048-237b-4cab-86e0-e56dce546daa is going to be deleted. [ 1087.828738] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.828946] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.868981] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.869091] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.889696] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.889804] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ffefe95f-97fb-4dd1-96fc-f444084d7691 is going to be deleted. [ 1087.890685] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.890896] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.945732] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.945867] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e245eb8-32e9-4599-974c-039ad69ab827 is going to be deleted. [ 1087.947054] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.947054] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.983441] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.983632] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.990041] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.990158] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.992515] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('46c016e6-244a-4247-9a9f-a7b0e21f0989',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.993993] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.010729] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-428 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.010927] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-428" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.011071] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-428" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.011422] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-428" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.011692] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.011855] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.011973] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.012292] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.012650] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.012717] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1088.012857] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1088.012993] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1088.013143] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1088.013336] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1088.013504] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1088.013677] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1088.023932] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4e505537-e930-46b3-bee1-b6cba5260d3d: rpc.has_security_group_logging(os_id): False [ 1088.029420] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.029420] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a93825c-656b-4f3f-b946-3346edd746bf is going to be deleted. [ 1088.030282] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.030509] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.065190] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1088.065364] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.052 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1088.065514] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1088.065686] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-428" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.065985] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-a7846129-d037-4b74-aaa6-f7dd287d878d taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.066172] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-a7846129-d037-4b74-aaa6-f7dd287d878d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.066292] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-a7846129-d037-4b74-aaa6-f7dd287d878d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.066597] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-a7846129-d037-4b74-aaa6-f7dd287d878d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.066759] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7846129-d037-4b74-aaa6-f7dd287d878d',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.080090] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.080090] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.080090] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.080090] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.084865] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.084971] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.091308] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.091431] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c661804-19d8-4b01-b7d8-b4d1885cc85f is going to be deleted. [ 1088.092309] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fa4fd6a5-5b80-4a63-9124-bbb06edc03a7',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.092989] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.096980] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.177855] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.178030] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.178074] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.178274] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.178370] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.178549] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8f5efec-a14e-4be6-8add-7b35a995c982 is going to be updated. [ 1088.180470] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.180580] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b9410f01-20de-42de-8117-bdf11cf59643 is going to be deleted. [ 1088.181609] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.181965] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.213765] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.213893] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.226932] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.226932] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.253432] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.253750] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.256963] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.257105] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f7d8ca5-61df-4ea2-b964-843e08d1b082 is going to be deleted. [ 1088.258057] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.258261] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.269978] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.270138] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.270316] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.270517] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.270669] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.284366] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: IN_PROGRESS for 2s [ 1088.300723] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.301035] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 837be310-7b7c-4ed0-9877-3473fe63d929 is going to be deleted. [ 1088.301899] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.302138] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.303742] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.303850] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.364881] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.364881] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 380030c5-e260-46fb-aa7e-5000c5bc9507 is going to be deleted. [ 1088.365262] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.365463] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.365553] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.365705] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4402a532-4a5c-4a18-993a-a6249c552031" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.365868] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.366044] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.366126] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.366243] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1575c38c-2999-4e79-86e3-5e41e8eaa04a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.366716] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.366891] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.366973] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.367493] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e0a8aca-d575-4597-b049-0d3d263dac47" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.367643] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.367794] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.367873] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.367984] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3cd125ff-382e-4eec-ae57-a26a30a63320" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.371727] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.371727] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.371727] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.371727] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b221064c-6962-44ea-989e-cf4546ea92ab" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.371727] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.371727] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.371727] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.371727] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e9c0048-237b-4cab-86e0-e56dce546daa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.371727] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.371727] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.371727] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.371727] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5ec7f171-db73-4bef-97dc-92782231e84b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.371727] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.371727] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.392930] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.393112] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.409229] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.409555] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.409651] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.409716] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.409916] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.409999] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.410106] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e505537-e930-46b3-bee1-b6cba5260d3d is going to be updated. [ 1088.411194] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.411385] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.411470] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.411586] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e245eb8-32e9-4599-974c-039ad69ab827" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.411718] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.411861] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.411927] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.412333] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ffefe95f-97fb-4dd1-96fc-f444084d7691" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.413089] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.413199] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.413251] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.413451] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.413528] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.413643] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-837be310-7b7c-4ed0-9877-3473fe63d929" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.413760] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.413976] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.414053] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.414162] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a93825c-656b-4f3f-b946-3346edd746bf" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.414271] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.414412] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.414521] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.415661] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.415661] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.415661] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.415661] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.415661] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.415661] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01588700-3c33-4723-87f1-c5abc176445e already deleted. [ 1088.415661] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.416115] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.416115] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.416207] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.416275] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c661804-19d8-4b01-b7d8-b4d1885cc85f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.416409] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.416550] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.416626] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.416729] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b9410f01-20de-42de-8117-bdf11cf59643" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.416837] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.416973] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.417060] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.417165] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f7d8ca5-61df-4ea2-b964-843e08d1b082" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.482582] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.482737] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.482826] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.483075] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.483186] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.483316] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-380030c5-e260-46fb-aa7e-5000c5bc9507" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.495910] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 46c016e6-244a-4247-9a9f-a7b0e21f0989: rpc.has_security_group_logging(os_id): False [ 1088.499412] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b: rpc.has_security_group_logging(os_id): False [ 1088.537657] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.537804] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.537877] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.538107] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.541481] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.541587] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.566686] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.566969] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.567082] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.567148] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.567337] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.567420] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.567507] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b is going to be updated. [ 1088.568657] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.568823] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.569861] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.570058] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.570185] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.570402] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.570543] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.570760] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port a7846129-d037-4b74-aaa6-f7dd287d878d not found, creating... [ 1088.570938] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.571110] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.571231] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.571457] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.571596] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.571870] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.572044] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.572166] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.572370] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.572506] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.572643] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: a7846129-d037-4b74-aaa6-f7dd287d878d is going to be created. [ 1088.595749] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.595749] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.595749] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.595749] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.595749] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.595749] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.595749] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.595749] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa4fd6a5-5b80-4a63-9124-bbb06edc03a7 is going to be created. [ 1088.611098] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.611323] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.611509] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.611823] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.612097] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.612360] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-a7846129-d037-4b74-aaa6-f7dd287d878d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.613849] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.614174] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.614346] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.614420] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.614592] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.614672] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.614757] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46c016e6-244a-4247-9a9f-a7b0e21f0989 is going to be updated. [ 1088.615820] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.615883] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.616053] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.635612] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.635746] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.635825] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.636034] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.636189] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.638114] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e505537-e930-46b3-bee1-b6cba5260d3d in Status: IN_PROGRESS for 2s [ 1088.643648] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa4fd6a5-5b80-4a63-9124-bbb06edc03a7 in Status: UNINITIALIZED for 2s [ 1088.673546] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.673751] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.673751] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.674013] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.674170] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.690258] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b in Status: IN_PROGRESS for 2s [ 1088.741314] env[70764]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1088.742038] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.742215] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.742296] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.742541] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.742850] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.764477] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46c016e6-244a-4247-9a9f-a7b0e21f0989 in Status: IN_PROGRESS for 2s [ 1089.254982] env[70764]: INFO networking_nsxv3.common.synchronization [req-babc11e3-c299-4a70-ae8b-6c584a6d76bb req-2e0ff3a1-1106-47eb-8fef-f9e54b0d03bd service nova] Enqueued Resource ID: 01588700-3c33-4723-87f1-c5abc176445e with Priority: HIGHEST for action security_group_rules [ 1089.255338] env[70764]: INFO networking_nsxv3.common.synchronization [req-babc11e3-c299-4a70-ae8b-6c584a6d76bb req-2e0ff3a1-1106-47eb-8fef-f9e54b0d03bd service nova] Enqueued Resource ID: 01588700-3c33-4723-87f1-c5abc176445e with Priority: HIGHEST for action security_group_members [ 1089.255641] env[70764]: INFO networking_nsxv3.common.synchronization [req-babc11e3-c299-4a70-ae8b-6c584a6d76bb req-2e0ff3a1-1106-47eb-8fef-f9e54b0d03bd service nova] Enqueued Resource ID: a7846129-d037-4b74-aaa6-f7dd287d878d with Priority: HIGHEST for action port [ 1089.256448] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01588700-3c33-4723-87f1-c5abc176445e with Priority: HIGHEST for action security_group_rules [ 1089.256690] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01588700-3c33-4723-87f1-c5abc176445e with Priority: HIGHEST for action security_group_members [ 1089.256900] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7846129-d037-4b74-aaa6-f7dd287d878d with Priority: HIGHEST for action port [ 1089.257368] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01588700-3c33-4723-87f1-c5abc176445e taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.257542] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.257647] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.258040] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.258159] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01588700-3c33-4723-87f1-c5abc176445e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.260085] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-01588700-3c33-4723-87f1-c5abc176445e taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.260085] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.260085] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.260085] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.260085] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.260085] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.260085] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.260520] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.260520] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.260520] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01588700-3c33-4723-87f1-c5abc176445e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.261394] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7846129-d037-4b74-aaa6-f7dd287d878d taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.261531] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7846129-d037-4b74-aaa6-f7dd287d878d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.261608] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7846129-d037-4b74-aaa6-f7dd287d878d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.261810] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7846129-d037-4b74-aaa6-f7dd287d878d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.261928] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7846129-d037-4b74-aaa6-f7dd287d878d',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.623315] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3379805b-13ae-4057-9511-570e8b3c2437 in Status: SUCCESS [ 1089.623315] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3379805b-13ae-4057-9511-570e8b3c2437 deletion is rescheduled due to dependency. [ 1089.623315] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.763644] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01588700-3c33-4723-87f1-c5abc176445e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.764749] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-01588700-3c33-4723-87f1-c5abc176445e taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.764861] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.765231] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a7846129-d037-4b74-aaa6-f7dd287d878d with status ACTIVE [ 1089.765404] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.765513] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.765625] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.765887] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.766014] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.766205] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.766305] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.766420] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.766516] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.766638] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.766763] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.766854] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.766913] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.767221] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.767319] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.767409] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a7846129-d037-4b74-aaa6-f7dd287d878d is going to be updated. [ 1089.791602] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.791739] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.791808] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.791996] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.792137] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.792284] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7846129-d037-4b74-aaa6-f7dd287d878d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.266515] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01588700-3c33-4723-87f1-c5abc176445e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.300169] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: SUCCESS [ 1090.300284] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.300773] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.300991] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.301218] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.301350] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.301421] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.301577] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.301663] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.301730] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.301821] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.653745] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa4fd6a5-5b80-4a63-9124-bbb06edc03a7 in Status: SUCCESS [ 1090.654334] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa4fd6a5-5b80-4a63-9124-bbb06edc03a7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.654334] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa4fd6a5-5b80-4a63-9124-bbb06edc03a7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.654334] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa4fd6a5-5b80-4a63-9124-bbb06edc03a7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.654795] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.654795] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.654795] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.655096] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.655096] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.656035] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa4fd6a5-5b80-4a63-9124-bbb06edc03a7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.656035] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fa4fd6a5-5b80-4a63-9124-bbb06edc03a7',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.657226] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e505537-e930-46b3-bee1-b6cba5260d3d in Status: SUCCESS [ 1090.657336] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.709243] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b in Status: SUCCESS [ 1090.709243] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.768750] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.768883] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.768957] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.769275] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.769275] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.769401] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01588700-3c33-4723-87f1-c5abc176445e is going to be created. [ 1090.777595] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46c016e6-244a-4247-9a9f-a7b0e21f0989 in Status: SUCCESS [ 1090.777881] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46c016e6-244a-4247-9a9f-a7b0e21f0989" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.789737] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.789737] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.789737] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.789930] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.790651] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.798158] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01588700-3c33-4723-87f1-c5abc176445e in Status: UNINITIALIZED for 2s [ 1090.804336] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.804476] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.804522] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.804723] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.804877] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.805058] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.805058] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.805201] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.805269] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.805431] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.805609] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.805609] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.805609] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.805803] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.806020] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.806020] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.806172] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.806172] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.806265] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.806334] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.806435] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.158735] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa4fd6a5-5b80-4a63-9124-bbb06edc03a7 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.158903] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa4fd6a5-5b80-4a63-9124-bbb06edc03a7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.159265] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa4fd6a5-5b80-4a63-9124-bbb06edc03a7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.159265] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa4fd6a5-5b80-4a63-9124-bbb06edc03a7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.159469] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.159581] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.159686] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.162073] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.162073] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.162073] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa4fd6a5-5b80-4a63-9124-bbb06edc03a7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.162073] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa4fd6a5-5b80-4a63-9124-bbb06edc03a7 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.162073] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa4fd6a5-5b80-4a63-9124-bbb06edc03a7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.162073] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa4fd6a5-5b80-4a63-9124-bbb06edc03a7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.162073] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa4fd6a5-5b80-4a63-9124-bbb06edc03a7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.162073] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.162073] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.162073] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.162073] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.162073] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.162073] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa4fd6a5-5b80-4a63-9124-bbb06edc03a7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.162073] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fa4fd6a5-5b80-4a63-9124-bbb06edc03a7',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.308532] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f8f5efec-a14e-4be6-8add-7b35a995c982: rpc.has_security_group_logging(os_id): False [ 1091.329564] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.329841] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.330032] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.330298] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.350296] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.350570] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.350685] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.350751] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.351104] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.351104] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.351363] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.351471] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.351575] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.351697] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.351812] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.351962] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.352064] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.352120] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.352260] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.352333] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.352423] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8f5efec-a14e-4be6-8add-7b35a995c982 is going to be updated. [ 1091.412339] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.412554] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.412612] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.412805] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.412981] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.430154] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: IN_PROGRESS for 2s [ 1091.667401] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fa4fd6a5-5b80-4a63-9124-bbb06edc03a7: rpc.has_security_group_logging(os_id): False [ 1091.686520] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.686520] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.686520] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.686520] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.686520] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.686520] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.686520] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.686520] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.686520] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.686520] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.686520] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.686520] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.686520] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.686520] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.686520] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.687258] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.687258] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.687258] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.687258] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.687258] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.687258] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fa4fd6a5-5b80-4a63-9124-bbb06edc03a7 is going to be created. [ 1091.751827] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.751827] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.751827] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.752019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.752118] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.762748] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa4fd6a5-5b80-4a63-9124-bbb06edc03a7 in Status: IN_PROGRESS for 2s [ 1092.807277] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01588700-3c33-4723-87f1-c5abc176445e in Status: SUCCESS [ 1092.807596] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.807596] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.807803] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.807997] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.808115] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.808174] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.808334] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.808407] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.808490] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.808582] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('01588700-3c33-4723-87f1-c5abc176445e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.311650] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-01588700-3c33-4723-87f1-c5abc176445e taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.311832] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.311906] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.312136] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.312267] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.312368] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.312433] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.312633] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.312698] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.312775] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.312926] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-01588700-3c33-4723-87f1-c5abc176445e taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.313050] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.313087] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.313249] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.313446] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.313563] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.313618] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.313769] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.313846] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.314287] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.314287] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('01588700-3c33-4723-87f1-c5abc176445e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.445020] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: SUCCESS [ 1093.445361] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.445529] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.446266] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.446266] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.774457] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa4fd6a5-5b80-4a63-9124-bbb06edc03a7 in Status: SUCCESS [ 1093.774457] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fa4fd6a5-5b80-4a63-9124-bbb06edc03a7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.817012] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 01588700-3c33-4723-87f1-c5abc176445e: rpc.has_security_group_logging(os_id): False [ 1093.838324] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.838476] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.838638] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.838764] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.838854] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.839064] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.839175] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.839269] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.839389] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.839467] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.839672] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.839771] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.839835] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.839975] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.840062] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.840252] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.840367] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.840449] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.840596] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.840672] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.840757] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01588700-3c33-4723-87f1-c5abc176445e is going to be created. [ 1093.897953] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.898205] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.898205] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.898406] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.898587] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.907900] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01588700-3c33-4723-87f1-c5abc176445e in Status: IN_PROGRESS for 2s [ 1093.948615] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.948842] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.948939] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.949258] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.949492] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.949638] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.949732] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.949939] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.950076] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.950211] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.950342] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.258425] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1094.258546] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1094.454511] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.454672] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.455028] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.455028] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.455137] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.455228] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.455287] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.456200] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.456200] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.456200] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.456200] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.456200] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.456200] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.456200] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.456200] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.456472] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.456472] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.456472] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.456547] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.456603] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.456681] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.964551] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f8f5efec-a14e-4be6-8add-7b35a995c982: rpc.has_security_group_logging(os_id): False [ 1094.982143] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.982344] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.982441] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.982660] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.982771] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.983023] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.983153] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.983222] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.983426] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.983508] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.983732] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.983833] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.983882] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.984037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.984106] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.984302] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.984395] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.984444] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.984579] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.984664] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.984767] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8f5efec-a14e-4be6-8add-7b35a995c982 is going to be updated. [ 1095.056722] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.056722] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.056722] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.056722] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.056722] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.073869] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: IN_PROGRESS for 2s [ 1095.920459] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01588700-3c33-4723-87f1-c5abc176445e in Status: SUCCESS [ 1095.920692] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.090517] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: SUCCESS [ 1097.090809] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.752376] env[70764]: INFO networking_nsxv3.common.synchronization [req-cb821786-3cf7-4be8-8744-7dc9d5a4f547 req-0820a61f-e8a4-48b3-b2ee-1178201ff1fa tempest-ImagesNegativeTestJSON-987179543 tempest-ImagesNegativeTestJSON-987179543-project-member] Enqueued Resource ID: fa4fd6a5-5b80-4a63-9124-bbb06edc03a7 with Priority: HIGHEST for action security_group_members [ 1097.753014] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa4fd6a5-5b80-4a63-9124-bbb06edc03a7 with Priority: HIGHEST for action security_group_members [ 1097.753359] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa4fd6a5-5b80-4a63-9124-bbb06edc03a7 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.753550] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa4fd6a5-5b80-4a63-9124-bbb06edc03a7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.753618] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa4fd6a5-5b80-4a63-9124-bbb06edc03a7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.753814] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa4fd6a5-5b80-4a63-9124-bbb06edc03a7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.753971] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.757261] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.757330] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.757507] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.757597] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.757696] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa4fd6a5-5b80-4a63-9124-bbb06edc03a7',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.260107] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.260362] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.260362] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.260564] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.260659] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.260871] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.260987] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.261061] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.261214] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.261291] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.261381] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa4fd6a5-5b80-4a63-9124-bbb06edc03a7 is going to be updated. [ 1098.287792] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.287946] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.288029] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.288241] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.288384] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.296559] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa4fd6a5-5b80-4a63-9124-bbb06edc03a7 in Status: IN_PROGRESS for 2s [ 1099.797921] env[70764]: INFO networking_nsxv3.common.synchronization [req-64aaa979-b6e5-4d59-af66-aae39486806a req-8ef96bee-5374-41e4-9353-d27ab105b9b5 tempest-ServersTestJSON-88830314 tempest-ServersTestJSON-88830314-project-member] Enqueued Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_members [ 1099.798464] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_members [ 1099.798770] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.799249] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.799249] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.799249] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.800156] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.800156] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.800156] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.800156] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.800156] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.800156] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.302321] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.313235] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa4fd6a5-5b80-4a63-9124-bbb06edc03a7 in Status: SUCCESS [ 1100.313535] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa4fd6a5-5b80-4a63-9124-bbb06edc03a7 deletion is rescheduled due to dependency. [ 1100.313694] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa4fd6a5-5b80-4a63-9124-bbb06edc03a7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.804648] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.306691] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.306891] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.306944] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.307199] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.307300] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.307375] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8f5efec-a14e-4be6-8add-7b35a995c982 is going to be updated. [ 1101.332308] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.333119] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.333119] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.333119] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.333119] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.340737] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: IN_PROGRESS for 2s [ 1102.117285] env[70764]: INFO networking_nsxv3.common.synchronization [req-98e30b88-1257-49d0-8475-24f0e49537fb req-87cecb63-473e-4e50-8657-c6f4a5451908 tempest-DeleteServersTestJSON-1788501793 tempest-DeleteServersTestJSON-1788501793-project-member] Enqueued Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGHEST for action security_group_members [ 1102.117906] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGHEST for action security_group_members [ 1102.118271] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-3379805b-13ae-4057-9511-570e8b3c2437 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.118406] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.118751] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.119028] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.119223] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.120886] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.120956] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.121179] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.121338] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.121487] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3379805b-13ae-4057-9511-570e8b3c2437',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.494413] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-974 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.494659] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-974" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.494792] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-974" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.495075] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-974" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.495636] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.495814] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.495939] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.496317] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.496526] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.496793] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1102.496974] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1102.497303] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1102.497303] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1102.497470] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1102.497621] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1102.497851] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1102.515615] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1102.515887] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1102.516113] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1102.516346] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-974" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.516788] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-d234cdd0-f553-44b8-b806-0d3976017b2d taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.517061] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-d234cdd0-f553-44b8-b806-0d3976017b2d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.517251] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-d234cdd0-f553-44b8-b806-0d3976017b2d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.517605] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-d234cdd0-f553-44b8-b806-0d3976017b2d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.517808] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d234cdd0-f553-44b8-b806-0d3976017b2d',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.623731] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.623960] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.623960] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.624810] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.624810] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.624810] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.624810] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.624810] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.624810] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.624810] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.625215] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3379805b-13ae-4057-9511-570e8b3c2437 is going to be updated. [ 1102.650181] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.651123] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.651320] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.651641] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.651887] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.660238] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3379805b-13ae-4057-9511-570e8b3c2437 in Status: IN_PROGRESS for 2s [ 1103.019717] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.019897] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.020015] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.020328] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.020481] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.020660] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port d234cdd0-f553-44b8-b806-0d3976017b2d not found, creating... [ 1103.020933] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.021110] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.021234] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.021463] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.021608] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.021890] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.022059] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.022189] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.022405] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.022542] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.022687] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: d234cdd0-f553-44b8-b806-0d3976017b2d is going to be created. [ 1103.041849] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.042076] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.042407] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.042660] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.042889] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.043434] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-d234cdd0-f553-44b8-b806-0d3976017b2d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.351875] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: SUCCESS [ 1103.352192] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.922733] env[70764]: INFO networking_nsxv3.common.synchronization [req-98e30b88-1257-49d0-8475-24f0e49537fb req-33d3239c-9482-4732-8a10-df1cab65c4cd service nova] Enqueued Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGHEST for action security_group_rules [ 1103.922733] env[70764]: INFO networking_nsxv3.common.synchronization [req-98e30b88-1257-49d0-8475-24f0e49537fb req-33d3239c-9482-4732-8a10-df1cab65c4cd service nova] Enqueued Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGHEST for action security_group_members [ 1103.922733] env[70764]: INFO networking_nsxv3.common.synchronization [req-98e30b88-1257-49d0-8475-24f0e49537fb req-33d3239c-9482-4732-8a10-df1cab65c4cd service nova] Enqueued Resource ID: d234cdd0-f553-44b8-b806-0d3976017b2d with Priority: HIGHEST for action port [ 1103.922733] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGHEST for action security_group_rules [ 1103.922733] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGHEST for action security_group_members [ 1103.922733] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d234cdd0-f553-44b8-b806-0d3976017b2d with Priority: HIGHEST for action port [ 1103.924403] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3379805b-13ae-4057-9511-570e8b3c2437 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.931135] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.931135] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.931135] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.931135] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3379805b-13ae-4057-9511-570e8b3c2437',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.931135] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-3379805b-13ae-4057-9511-570e8b3c2437 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.931135] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.931135] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-d234cdd0-f553-44b8-b806-0d3976017b2d taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.931135] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d234cdd0-f553-44b8-b806-0d3976017b2d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.931135] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d234cdd0-f553-44b8-b806-0d3976017b2d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.931135] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d234cdd0-f553-44b8-b806-0d3976017b2d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.931135] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d234cdd0-f553-44b8-b806-0d3976017b2d',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.433719] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-3379805b-13ae-4057-9511-570e8b3c2437 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.434144] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.434144] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d234cdd0-f553-44b8-b806-0d3976017b2d with status ACTIVE [ 1104.434325] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.434423] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.434423] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.434683] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.434771] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.434955] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.435104] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.435168] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.435273] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.435363] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.435532] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.435648] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.435750] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.435802] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.435883] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.435969] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d234cdd0-f553-44b8-b806-0d3976017b2d is going to be updated. [ 1104.455952] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.456170] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.456223] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.456403] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.456543] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.456697] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d234cdd0-f553-44b8-b806-0d3976017b2d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.670335] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3379805b-13ae-4057-9511-570e8b3c2437 in Status: SUCCESS [ 1104.670608] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3379805b-13ae-4057-9511-570e8b3c2437 deletion is rescheduled due to dependency. [ 1104.670716] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.670943] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.671230] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.671457] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.671605] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.671687] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.671891] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.671989] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.672409] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3379805b-13ae-4057-9511-570e8b3c2437',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.174552] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3379805b-13ae-4057-9511-570e8b3c2437',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.678434] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3379805b-13ae-4057-9511-570e8b3c2437',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.180873] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.181154] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.181241] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.181470] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.181566] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.181670] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3379805b-13ae-4057-9511-570e8b3c2437 is going to be updated. [ 1106.210216] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.210378] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.210449] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.210634] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.210776] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.220717] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3379805b-13ae-4057-9511-570e8b3c2437 in Status: IN_PROGRESS for 2s [ 1107.372108] env[70764]: INFO networking_nsxv3.common.synchronization [req-882e423c-6dc2-4606-a34e-3176aa81be9d req-7270461e-aace-4519-84c5-b57b50a82882 tempest-ListImageFiltersTestJSON-1188056954 tempest-ListImageFiltersTestJSON-1188056954-project-member] Enqueued Resource ID: 90e38802-c5d5-43ce-9d13-c67ca1804885 with Priority: HIGHEST for action security_group_members [ 1107.372702] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90e38802-c5d5-43ce-9d13-c67ca1804885 with Priority: HIGHEST for action security_group_members [ 1107.373170] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-90e38802-c5d5-43ce-9d13-c67ca1804885 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.373320] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.373402] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.373745] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.373995] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.374075] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.374163] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.374371] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.374460] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.374559] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90e38802-c5d5-43ce-9d13-c67ca1804885',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.834422] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-343 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.834673] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-343" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.834845] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-343" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.835132] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-343" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.835396] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.835555] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.835725] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.836010] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.836805] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.837089] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1107.837279] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1107.837784] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1107.837984] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1107.838176] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1107.838520] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1107.838744] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1107.857739] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1107.858259] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1107.858475] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1107.858704] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-343" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.859299] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-e17bedb7-ada2-4987-86fd-4ad7bc7ead54 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.859549] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-e17bedb7-ada2-4987-86fd-4ad7bc7ead54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.859884] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-e17bedb7-ada2-4987-86fd-4ad7bc7ead54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.860281] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-e17bedb7-ada2-4987-86fd-4ad7bc7ead54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.860912] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e17bedb7-ada2-4987-86fd-4ad7bc7ead54',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.876884] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.877054] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.877126] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.877323] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.877409] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.877601] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.877699] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.877783] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.877894] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.877969] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.878063] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90e38802-c5d5-43ce-9d13-c67ca1804885 already deleted. [ 1107.878144] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.964426] env[70764]: INFO networking_nsxv3.common.synchronization [None req-666211e0-89e7-40ff-834a-f44d2a4e35c2 None None] Enqueued Resource ID: b198ee7b-8d3b-47cd-87f8-7a8466a5511e with Priority: HIGHEST for action port [ 1107.964710] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b198ee7b-8d3b-47cd-87f8-7a8466a5511e with Priority: HIGHEST for action port [ 1107.965362] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-b198ee7b-8d3b-47cd-87f8-7a8466a5511e taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.965488] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b198ee7b-8d3b-47cd-87f8-7a8466a5511e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.965558] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b198ee7b-8d3b-47cd-87f8-7a8466a5511e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.965804] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b198ee7b-8d3b-47cd-87f8-7a8466a5511e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.965895] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b198ee7b-8d3b-47cd-87f8-7a8466a5511e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.232143] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3379805b-13ae-4057-9511-570e8b3c2437 in Status: SUCCESS [ 1108.236614] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.238205] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.238205] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.238205] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.238205] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.238205] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.238205] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.238205] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.238205] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.238205] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3379805b-13ae-4057-9511-570e8b3c2437',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.363310] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.363521] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.363708] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.363989] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.364158] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.364317] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port e17bedb7-ada2-4987-86fd-4ad7bc7ead54 not found, creating... [ 1108.364591] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.364788] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.364918] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.365293] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.365350] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.365601] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.366896] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.366896] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.366896] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.366896] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.366896] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: e17bedb7-ada2-4987-86fd-4ad7bc7ead54 is going to be created. [ 1108.388198] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.388556] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.388556] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.388712] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.389132] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.389264] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-e17bedb7-ada2-4987-86fd-4ad7bc7ead54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.468377] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b198ee7b-8d3b-47cd-87f8-7a8466a5511e [ 1108.468602] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.468745] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.468817] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.469041] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.469369] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.469369] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b198ee7b-8d3b-47cd-87f8-7a8466a5511e already deleted. [ 1108.469369] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b198ee7b-8d3b-47cd-87f8-7a8466a5511e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.740946] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-3379805b-13ae-4057-9511-570e8b3c2437 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.741170] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.741237] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.741401] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.741625] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.741737] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.741818] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.741978] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.742074] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.742161] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.742316] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-3379805b-13ae-4057-9511-570e8b3c2437 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.742405] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.742458] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.742649] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.744037] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.744037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.744037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.744037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.744037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.744037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.744037] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3379805b-13ae-4057-9511-570e8b3c2437',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.786329] env[70764]: INFO networking_nsxv3.common.synchronization [None req-a8d2c140-76d6-4ca7-9e77-463638741488 tempest-AttachInterfacesTestJSON-1880347664 tempest-AttachInterfacesTestJSON-1880347664-project-member] Enqueued Resource ID: 6df71822-ed7d-4644-87b5-30eb51293fdd with Priority: HIGHEST for action security_group_rules [ 1108.786896] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6df71822-ed7d-4644-87b5-30eb51293fdd with Priority: HIGHEST for action security_group_rules [ 1108.787431] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6df71822-ed7d-4644-87b5-30eb51293fdd taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.787572] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6df71822-ed7d-4644-87b5-30eb51293fdd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.787631] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6df71822-ed7d-4644-87b5-30eb51293fdd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.787882] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6df71822-ed7d-4644-87b5-30eb51293fdd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.787957] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6df71822-ed7d-4644-87b5-30eb51293fdd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.926968] env[70764]: INFO networking_nsxv3.common.synchronization [None req-0d18a647-ad41-42c4-bdab-2288ec0fd896 tempest-AttachInterfacesTestJSON-1880347664 tempest-AttachInterfacesTestJSON-1880347664-project-member] Enqueued Resource ID: 6df71822-ed7d-4644-87b5-30eb51293fdd with Priority: HIGHEST for action security_group_rules [ 1108.927430] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6df71822-ed7d-4644-87b5-30eb51293fdd with Priority: HIGHEST for action security_group_rules [ 1108.927920] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6df71822-ed7d-4644-87b5-30eb51293fdd taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.928172] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6df71822-ed7d-4644-87b5-30eb51293fdd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.160514] env[70764]: INFO networking_nsxv3.common.synchronization [req-882e423c-6dc2-4606-a34e-3176aa81be9d req-f9f29f26-6d89-4afd-88eb-ded83c4db0e0 service nova] Enqueued Resource ID: 90e38802-c5d5-43ce-9d13-c67ca1804885 with Priority: HIGHEST for action security_group_rules [ 1109.160514] env[70764]: INFO networking_nsxv3.common.synchronization [req-882e423c-6dc2-4606-a34e-3176aa81be9d req-f9f29f26-6d89-4afd-88eb-ded83c4db0e0 service nova] Enqueued Resource ID: 90e38802-c5d5-43ce-9d13-c67ca1804885 with Priority: HIGHEST for action security_group_members [ 1109.160514] env[70764]: INFO networking_nsxv3.common.synchronization [req-882e423c-6dc2-4606-a34e-3176aa81be9d req-f9f29f26-6d89-4afd-88eb-ded83c4db0e0 service nova] Enqueued Resource ID: e17bedb7-ada2-4987-86fd-4ad7bc7ead54 with Priority: HIGHEST for action port [ 1109.160514] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90e38802-c5d5-43ce-9d13-c67ca1804885 with Priority: HIGHEST for action security_group_rules [ 1109.160514] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90e38802-c5d5-43ce-9d13-c67ca1804885 with Priority: HIGHEST for action security_group_members [ 1109.160514] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e17bedb7-ada2-4987-86fd-4ad7bc7ead54 with Priority: HIGHEST for action port [ 1109.160514] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-90e38802-c5d5-43ce-9d13-c67ca1804885 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.160514] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.160514] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.162047] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.162291] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('90e38802-c5d5-43ce-9d13-c67ca1804885',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.166816] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-90e38802-c5d5-43ce-9d13-c67ca1804885 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.166816] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.166816] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.167025] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.167720] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.167720] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.167720] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.167720] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.167720] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.167720] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90e38802-c5d5-43ce-9d13-c67ca1804885',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.169117] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-e17bedb7-ada2-4987-86fd-4ad7bc7ead54 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.169233] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e17bedb7-ada2-4987-86fd-4ad7bc7ead54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.169305] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e17bedb7-ada2-4987-86fd-4ad7bc7ead54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.172250] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e17bedb7-ada2-4987-86fd-4ad7bc7ead54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.172250] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e17bedb7-ada2-4987-86fd-4ad7bc7ead54',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.245927] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3379805b-13ae-4057-9511-570e8b3c2437: rpc.has_security_group_logging(os_id): False [ 1109.263541] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.263541] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.263541] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.263541] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.263541] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.263884] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.263952] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.264104] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.264327] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.264470] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.264819] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.265033] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.265198] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.265455] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.265565] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.265874] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.266053] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.266172] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.266403] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.267606] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.268167] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3379805b-13ae-4057-9511-570e8b3c2437 is going to be updated. [ 1109.312985] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.312985] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.312985] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.312985] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.312985] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.312985] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6df71822-ed7d-4644-87b5-30eb51293fdd already deleted. [ 1109.312985] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6df71822-ed7d-4644-87b5-30eb51293fdd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.312985] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6df71822-ed7d-4644-87b5-30eb51293fdd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.312985] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6df71822-ed7d-4644-87b5-30eb51293fdd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.312985] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6df71822-ed7d-4644-87b5-30eb51293fdd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.335032] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.335191] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.335249] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.335505] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.335583] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.346894] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3379805b-13ae-4057-9511-570e8b3c2437 in Status: IN_PROGRESS for 2s [ 1109.667379] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-90e38802-c5d5-43ce-9d13-c67ca1804885 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.667679] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.676056] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('90e38802-c5d5-43ce-9d13-c67ca1804885',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.677096] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e17bedb7-ada2-4987-86fd-4ad7bc7ead54 with status ACTIVE [ 1109.677323] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.677463] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.677547] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.677887] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.678047] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.678259] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.678374] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.678442] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.678639] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.678725] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.678919] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.679032] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.679098] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.679250] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.679328] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.679419] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e17bedb7-ada2-4987-86fd-4ad7bc7ead54 is going to be updated. [ 1109.703040] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.703040] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.703040] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.703040] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.703040] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.703040] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e17bedb7-ada2-4987-86fd-4ad7bc7ead54" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.832189] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.832386] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.832459] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.832671] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.832778] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.832889] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6df71822-ed7d-4644-87b5-30eb51293fdd already deleted. [ 1109.832975] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6df71822-ed7d-4644-87b5-30eb51293fdd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.041706] env[70764]: INFO networking_nsxv3.common.synchronization [req-7eee94e0-cbb3-4010-a7ec-aa5ba83f3b8c req-13f4087f-0570-40df-ac56-7578c460375b tempest-ListImageFiltersTestJSON-1188056954 tempest-ListImageFiltersTestJSON-1188056954-project-member] Enqueued Resource ID: 90e38802-c5d5-43ce-9d13-c67ca1804885 with Priority: HIGHEST for action security_group_members [ 1110.042267] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90e38802-c5d5-43ce-9d13-c67ca1804885 with Priority: HIGHEST for action security_group_members [ 1110.042639] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-90e38802-c5d5-43ce-9d13-c67ca1804885 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.042761] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.184692] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('90e38802-c5d5-43ce-9d13-c67ca1804885',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.376069] env[70764]: INFO networking_nsxv3.common.synchronization [None req-bc6ee170-8737-439a-afdd-3e31e1d2fa71 None None] Enqueued Resource ID: 321e65a5-86a8-440b-bff2-56e2cd2e79e2 with Priority: HIGHEST for action port [ 1110.376498] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 321e65a5-86a8-440b-bff2-56e2cd2e79e2 with Priority: HIGHEST for action port [ 1110.377473] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-321e65a5-86a8-440b-bff2-56e2cd2e79e2 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.377473] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-321e65a5-86a8-440b-bff2-56e2cd2e79e2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.377473] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-321e65a5-86a8-440b-bff2-56e2cd2e79e2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.377473] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-321e65a5-86a8-440b-bff2-56e2cd2e79e2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.377727] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('321e65a5-86a8-440b-bff2-56e2cd2e79e2',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.601702] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-343 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.604412] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-343" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.604412] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-343" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.604412] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-343" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.604585] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.604759] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.604880] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.605513] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.605513] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.605513] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1110.605653] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1110.605686] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1110.606044] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1110.606175] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1110.606353] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1110.606498] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1110.625234] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1110.625398] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1110.625540] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1110.625728] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-343" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.626091] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-55785cce-e15a-4ba1-b43f-517baacd825c taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.627868] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-55785cce-e15a-4ba1-b43f-517baacd825c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.627868] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-55785cce-e15a-4ba1-b43f-517baacd825c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.627868] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-55785cce-e15a-4ba1-b43f-517baacd825c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.627868] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55785cce-e15a-4ba1-b43f-517baacd825c',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.684944] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.684944] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.684944] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.685374] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.685374] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.685374] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90e38802-c5d5-43ce-9d13-c67ca1804885 is going to be created. [ 1110.709643] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.709912] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.710013] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.710239] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.710398] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.721133] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90e38802-c5d5-43ce-9d13-c67ca1804885 in Status: UNINITIALIZED for 2s [ 1110.880100] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 321e65a5-86a8-440b-bff2-56e2cd2e79e2 [ 1110.880281] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.880353] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.880400] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.880659] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.880806] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.880928] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:321e65a5-86a8-440b-bff2-56e2cd2e79e2 already deleted. [ 1110.881052] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-321e65a5-86a8-440b-bff2-56e2cd2e79e2" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.130310] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.130605] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.130752] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.131094] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.131286] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.131528] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 55785cce-e15a-4ba1-b43f-517baacd825c not found, creating... [ 1111.131968] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.132228] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.132395] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.132715] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.132935] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.133344] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.133603] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.133830] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.134195] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.134430] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.134706] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 55785cce-e15a-4ba1-b43f-517baacd825c is going to be created. [ 1111.160304] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.160618] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.160843] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.161211] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.161568] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.161890] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-55785cce-e15a-4ba1-b43f-517baacd825c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.367316] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3379805b-13ae-4057-9511-570e8b3c2437 in Status: SUCCESS [ 1111.367754] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.173206] env[70764]: INFO networking_nsxv3.common.synchronization [req-7eee94e0-cbb3-4010-a7ec-aa5ba83f3b8c req-38a3a8a5-0ec7-4234-86f3-b3e142b8aa9c service nova] Enqueued Resource ID: 90e38802-c5d5-43ce-9d13-c67ca1804885 with Priority: HIGHEST for action security_group_rules [ 1112.173757] env[70764]: INFO networking_nsxv3.common.synchronization [req-7eee94e0-cbb3-4010-a7ec-aa5ba83f3b8c req-38a3a8a5-0ec7-4234-86f3-b3e142b8aa9c service nova] Enqueued Resource ID: 90e38802-c5d5-43ce-9d13-c67ca1804885 with Priority: HIGHEST for action security_group_members [ 1112.173757] env[70764]: INFO networking_nsxv3.common.synchronization [req-7eee94e0-cbb3-4010-a7ec-aa5ba83f3b8c req-38a3a8a5-0ec7-4234-86f3-b3e142b8aa9c service nova] Enqueued Resource ID: 55785cce-e15a-4ba1-b43f-517baacd825c with Priority: HIGHEST for action port [ 1112.173998] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90e38802-c5d5-43ce-9d13-c67ca1804885 with Priority: HIGHEST for action security_group_rules [ 1112.174554] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90e38802-c5d5-43ce-9d13-c67ca1804885 with Priority: HIGHEST for action security_group_members [ 1112.174736] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55785cce-e15a-4ba1-b43f-517baacd825c with Priority: HIGHEST for action port [ 1112.175112] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-90e38802-c5d5-43ce-9d13-c67ca1804885 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.175373] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.175650] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-90e38802-c5d5-43ce-9d13-c67ca1804885 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.175797] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.176139] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-55785cce-e15a-4ba1-b43f-517baacd825c taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.176407] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55785cce-e15a-4ba1-b43f-517baacd825c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.176469] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55785cce-e15a-4ba1-b43f-517baacd825c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.176681] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55785cce-e15a-4ba1-b43f-517baacd825c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.176767] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55785cce-e15a-4ba1-b43f-517baacd825c',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.304695] env[70764]: INFO networking_nsxv3.common.synchronization [req-59e2d3f0-ccb0-4bf3-80a7-e96b89223146 req-ce293299-2de2-4224-a8b3-23b693c95307 tempest-ServersNegativeTestJSON-791332416 tempest-ServersNegativeTestJSON-791332416-project-member] Enqueued Resource ID: 01588700-3c33-4723-87f1-c5abc176445e with Priority: HIGHEST for action security_group_members [ 1112.305338] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01588700-3c33-4723-87f1-c5abc176445e with Priority: HIGHEST for action security_group_members [ 1112.305681] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-01588700-3c33-4723-87f1-c5abc176445e taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.305864] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.305900] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.308786] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.308976] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.309098] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.309169] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.309461] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.309461] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.309542] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01588700-3c33-4723-87f1-c5abc176445e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.679392] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 55785cce-e15a-4ba1-b43f-517baacd825c with status ACTIVE [ 1112.679584] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.679725] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.679796] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.680013] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.680115] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.680293] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.680395] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.680459] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.680612] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.680689] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.680885] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.680976] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.681049] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.681195] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.681271] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.681356] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 55785cce-e15a-4ba1-b43f-517baacd825c is going to be updated. [ 1112.701588] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.701752] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.701824] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.702028] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.702163] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.702437] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55785cce-e15a-4ba1-b43f-517baacd825c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.729906] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90e38802-c5d5-43ce-9d13-c67ca1804885 in Status: SUCCESS [ 1112.730158] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.730320] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.730532] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.730734] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.730857] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.730923] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.731091] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.731175] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.731259] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.731354] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('90e38802-c5d5-43ce-9d13-c67ca1804885',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.732491] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.732491] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.732647] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.732647] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.732732] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.735462] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.735462] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.735462] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90e38802-c5d5-43ce-9d13-c67ca1804885',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.811988] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01588700-3c33-4723-87f1-c5abc176445e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.939577] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-428 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.939785] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-428" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.939912] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-428" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.940213] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-428" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.940479] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.940643] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.940769] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.940993] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.941151] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.941368] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1112.941486] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1112.941624] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1112.941765] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1112.941883] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1112.941992] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1112.942144] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1112.966291] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1112.966506] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1112.966734] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1112.966975] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-428" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.967397] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-0521c8b7-f251-498e-aa56-9418535e2ae7 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.967603] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-0521c8b7-f251-498e-aa56-9418535e2ae7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.967795] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-0521c8b7-f251-498e-aa56-9418535e2ae7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.968229] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-0521c8b7-f251-498e-aa56-9418535e2ae7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.968403] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0521c8b7-f251-498e-aa56-9418535e2ae7',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.236566] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-90e38802-c5d5-43ce-9d13-c67ca1804885 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.237095] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.237095] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('90e38802-c5d5-43ce-9d13-c67ca1804885',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.317264] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01588700-3c33-4723-87f1-c5abc176445e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.352782] env[70764]: INFO networking_nsxv3.common.synchronization [req-4ba6c9e7-edcd-4227-bedc-0f4514edd001 req-deb66a68-2437-4619-8d27-360279af30a1 tempest-AttachVolumeTestJSON-503324066 tempest-AttachVolumeTestJSON-503324066-project-member] Enqueued Resource ID: 46c016e6-244a-4247-9a9f-a7b0e21f0989 with Priority: HIGHEST for action security_group_members [ 1113.352782] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46c016e6-244a-4247-9a9f-a7b0e21f0989 with Priority: HIGHEST for action security_group_members [ 1113.353104] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-46c016e6-244a-4247-9a9f-a7b0e21f0989 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.353562] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46c016e6-244a-4247-9a9f-a7b0e21f0989" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.353746] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46c016e6-244a-4247-9a9f-a7b0e21f0989" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.353959] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46c016e6-244a-4247-9a9f-a7b0e21f0989" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.354148] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.354271] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.354325] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.354482] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.354594] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.354732] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46c016e6-244a-4247-9a9f-a7b0e21f0989',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.473094] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.473094] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.473094] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.473094] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.473094] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.473094] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 0521c8b7-f251-498e-aa56-9418535e2ae7 not found, creating... [ 1113.473094] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.473094] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.473094] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.473094] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.473094] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.473606] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.474326] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.474718] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.475197] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.475605] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.475977] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 0521c8b7-f251-498e-aa56-9418535e2ae7 is going to be created. [ 1113.495597] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.496936] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.497281] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.497281] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.497281] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.497281] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-0521c8b7-f251-498e-aa56-9418535e2ae7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.743087] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('90e38802-c5d5-43ce-9d13-c67ca1804885',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.818134] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.818322] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.818412] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.818656] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.818750] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.818853] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01588700-3c33-4723-87f1-c5abc176445e is going to be updated. [ 1113.844734] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.845336] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.845336] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.845336] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.845557] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.858093] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01588700-3c33-4723-87f1-c5abc176445e in Status: IN_PROGRESS for 2s [ 1113.858436] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.858567] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.858639] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.858922] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.858922] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.859126] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.859259] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.859303] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.859462] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.859493] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.859571] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46c016e6-244a-4247-9a9f-a7b0e21f0989 is going to be updated. [ 1113.881592] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.881786] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.881863] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.882015] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.882157] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.890346] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46c016e6-244a-4247-9a9f-a7b0e21f0989 in Status: IN_PROGRESS for 2s [ 1114.245789] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.245789] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.245789] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.245789] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.246168] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.246168] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90e38802-c5d5-43ce-9d13-c67ca1804885 is going to be updated. [ 1114.249256] env[70764]: INFO networking_nsxv3.common.synchronization [req-59e2d3f0-ccb0-4bf3-80a7-e96b89223146 req-c8652c5f-8b32-46ab-9044-7c6e3c195efc service nova] Enqueued Resource ID: 01588700-3c33-4723-87f1-c5abc176445e with Priority: HIGHEST for action security_group_rules [ 1114.249571] env[70764]: INFO networking_nsxv3.common.synchronization [req-59e2d3f0-ccb0-4bf3-80a7-e96b89223146 req-c8652c5f-8b32-46ab-9044-7c6e3c195efc service nova] Enqueued Resource ID: 01588700-3c33-4723-87f1-c5abc176445e with Priority: HIGHEST for action security_group_members [ 1114.249786] env[70764]: INFO networking_nsxv3.common.synchronization [req-59e2d3f0-ccb0-4bf3-80a7-e96b89223146 req-c8652c5f-8b32-46ab-9044-7c6e3c195efc service nova] Enqueued Resource ID: 0521c8b7-f251-498e-aa56-9418535e2ae7 with Priority: HIGHEST for action port [ 1114.250823] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01588700-3c33-4723-87f1-c5abc176445e with Priority: HIGHEST for action security_group_rules [ 1114.251408] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01588700-3c33-4723-87f1-c5abc176445e with Priority: HIGHEST for action security_group_members [ 1114.251636] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0521c8b7-f251-498e-aa56-9418535e2ae7 with Priority: HIGHEST for action port [ 1114.251962] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01588700-3c33-4723-87f1-c5abc176445e taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.252248] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.252323] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.252543] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.252635] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01588700-3c33-4723-87f1-c5abc176445e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.253578] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-01588700-3c33-4723-87f1-c5abc176445e taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.253659] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.253928] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-0521c8b7-f251-498e-aa56-9418535e2ae7 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.254102] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0521c8b7-f251-498e-aa56-9418535e2ae7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.254102] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0521c8b7-f251-498e-aa56-9418535e2ae7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.254272] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0521c8b7-f251-498e-aa56-9418535e2ae7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.254346] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0521c8b7-f251-498e-aa56-9418535e2ae7',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.277425] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.277744] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.277922] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.279562] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.279562] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.287426] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90e38802-c5d5-43ce-9d13-c67ca1804885 in Status: IN_PROGRESS for 2s [ 1114.756596] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-01588700-3c33-4723-87f1-c5abc176445e taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.756817] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.759255] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0521c8b7-f251-498e-aa56-9418535e2ae7 with status ACTIVE [ 1114.759476] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.759624] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.759696] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.759927] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.760022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.760190] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.760273] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.760354] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.760520] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.760607] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.760772] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.760880] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.760939] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.761111] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.761189] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.761275] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0521c8b7-f251-498e-aa56-9418535e2ae7 is going to be updated. [ 1114.784811] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.784965] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.785111] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.785387] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.785569] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.785771] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0521c8b7-f251-498e-aa56-9418535e2ae7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.867247] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01588700-3c33-4723-87f1-c5abc176445e in Status: SUCCESS [ 1115.867635] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.867635] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.867883] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.868083] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.868213] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.868283] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.868445] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.868523] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.868620] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01588700-3c33-4723-87f1-c5abc176445e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.898647] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46c016e6-244a-4247-9a9f-a7b0e21f0989 in Status: SUCCESS [ 1115.898896] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46c016e6-244a-4247-9a9f-a7b0e21f0989 deletion is rescheduled due to dependency. [ 1115.899055] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46c016e6-244a-4247-9a9f-a7b0e21f0989" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.298163] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90e38802-c5d5-43ce-9d13-c67ca1804885 in Status: SUCCESS [ 1116.298413] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.298642] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.298909] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.299159] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.299302] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.299367] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.299540] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.299639] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.299757] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90e38802-c5d5-43ce-9d13-c67ca1804885',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.371381] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01588700-3c33-4723-87f1-c5abc176445e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.801858] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('90e38802-c5d5-43ce-9d13-c67ca1804885',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.818727] env[70764]: INFO networking_nsxv3.common.synchronization [req-fd84a888-5ef9-4637-bc0d-fc3b9d647166 req-d18cd1ee-e574-4ec3-8b06-4397a844fc2a tempest-ServersTestJSON-88830314 tempest-ServersTestJSON-88830314-project-member] Enqueued Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_members [ 1116.819745] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGHEST for action security_group_members [ 1116.819745] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.819745] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.819745] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.820073] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.822402] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.823013] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.823106] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.823316] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.823409] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.823510] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.874931] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01588700-3c33-4723-87f1-c5abc176445e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.939033] env[70764]: INFO networking_nsxv3.common.synchronization [req-95656b4b-57e2-4c63-872e-b74faa8983c3 req-b5bb1e33-4ac3-475f-82ff-0be1f37224e8 tempest-DeleteServersTestJSON-1788501793 tempest-DeleteServersTestJSON-1788501793-project-member] Enqueued Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGHEST for action security_group_members [ 1116.939033] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGHEST for action security_group_members [ 1116.939033] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-3379805b-13ae-4057-9511-570e8b3c2437 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.939033] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.939033] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.939033] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.939033] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.939601] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.939726] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.939920] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.940025] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.940181] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3379805b-13ae-4057-9511-570e8b3c2437',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.304061] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('90e38802-c5d5-43ce-9d13-c67ca1804885',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.325552] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.325712] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.325790] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.326020] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.326138] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.326348] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.326479] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.326523] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.326676] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.326740] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.326868] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8f5efec-a14e-4be6-8add-7b35a995c982 is going to be updated. [ 1117.369503] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.369721] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.369721] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.369960] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.370129] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.377921] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.378109] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.378157] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.378382] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.378492] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.378600] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01588700-3c33-4723-87f1-c5abc176445e is going to be updated. [ 1117.381104] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: IN_PROGRESS for 2s [ 1117.407175] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.407381] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.407438] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.407734] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.407917] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.416589] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01588700-3c33-4723-87f1-c5abc176445e in Status: IN_PROGRESS for 2s [ 1117.442617] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.442777] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.442883] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.443208] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.443317] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.443638] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.443786] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.443863] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.444058] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.444142] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.444251] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3379805b-13ae-4057-9511-570e8b3c2437 is going to be updated. [ 1117.507611] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.507611] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.507611] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.507611] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.507611] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.515698] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3379805b-13ae-4057-9511-570e8b3c2437 in Status: IN_PROGRESS for 2s [ 1117.806523] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.806727] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.806727] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.806966] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.807077] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.807181] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90e38802-c5d5-43ce-9d13-c67ca1804885 is going to be updated. [ 1118.005040] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.005040] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.005040] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.005040] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.005040] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.013944] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90e38802-c5d5-43ce-9d13-c67ca1804885 in Status: IN_PROGRESS for 2s [ 1119.391527] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f5efec-a14e-4be6-8add-7b35a995c982 in Status: SUCCESS [ 1119.391902] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8f5efec-a14e-4be6-8add-7b35a995c982 deletion is rescheduled due to dependency. [ 1119.391902] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.426887] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01588700-3c33-4723-87f1-c5abc176445e in Status: SUCCESS [ 1119.427128] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.427325] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.427550] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.427753] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.427872] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.427937] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.428123] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.428204] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.428290] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.428385] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('01588700-3c33-4723-87f1-c5abc176445e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.524727] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3379805b-13ae-4057-9511-570e8b3c2437 in Status: SUCCESS [ 1119.524896] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3379805b-13ae-4057-9511-570e8b3c2437 deletion is rescheduled due to dependency. [ 1119.525047] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.934584] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-01588700-3c33-4723-87f1-c5abc176445e taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.934584] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.934584] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.934584] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.934584] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.934584] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.934584] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.934584] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.934584] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.934584] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.934584] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-01588700-3c33-4723-87f1-c5abc176445e taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.934584] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.934584] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.934584] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.934584] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.934584] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.935194] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.935194] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.935194] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.935194] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.935194] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('01588700-3c33-4723-87f1-c5abc176445e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.024182] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90e38802-c5d5-43ce-9d13-c67ca1804885 in Status: SUCCESS [ 1120.024407] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.024578] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.024831] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.025270] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.025270] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.025270] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.025448] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.025448] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.025518] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.025676] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-90e38802-c5d5-43ce-9d13-c67ca1804885 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.025765] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.025821] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.025962] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.026119] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.026211] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.026260] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.026397] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.026471] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.026563] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.026657] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('90e38802-c5d5-43ce-9d13-c67ca1804885',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.436246] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 01588700-3c33-4723-87f1-c5abc176445e: rpc.has_security_group_logging(os_id): False [ 1120.458863] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.459032] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.459109] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.459336] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.459440] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.459634] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.459753] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.459817] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.459985] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.460076] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.460284] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.460395] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.460460] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.460613] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.460687] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.460889] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.460996] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.461068] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.461218] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.461293] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.461379] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01588700-3c33-4723-87f1-c5abc176445e is going to be updated. [ 1120.528827] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 90e38802-c5d5-43ce-9d13-c67ca1804885: rpc.has_security_group_logging(os_id): False [ 1120.539669] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.539818] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.539888] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.540153] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.540305] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.549777] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.549921] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.549995] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.550200] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.550301] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.550495] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.550605] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.550668] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.550842] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.550907] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.551239] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.551343] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.551412] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.551556] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.551632] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.551865] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.551999] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.552080] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.552224] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.552317] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.552429] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 90e38802-c5d5-43ce-9d13-c67ca1804885 is going to be created. [ 1120.554509] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01588700-3c33-4723-87f1-c5abc176445e in Status: IN_PROGRESS for 2s [ 1120.617639] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.617639] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.617639] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.617639] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.617887] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.630736] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 90e38802-c5d5-43ce-9d13-c67ca1804885 in Status: IN_PROGRESS for 2s [ 1120.760576] env[70764]: INFO networking_nsxv3.common.synchronization [req-736d0108-ed04-4d3d-87be-2e4a30045e04 req-03af5b54-c07a-4341-80d9-242d55b93472 tempest-VolumesAdminNegativeTest-2021792328 tempest-VolumesAdminNegativeTest-2021792328-project-member] Enqueued Resource ID: b7bb082e-1054-4b53-b47b-6d09047c4a9e with Priority: HIGHEST for action security_group_members [ 1120.761046] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7bb082e-1054-4b53-b47b-6d09047c4a9e with Priority: HIGHEST for action security_group_members [ 1120.761356] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7bb082e-1054-4b53-b47b-6d09047c4a9e taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.761479] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7bb082e-1054-4b53-b47b-6d09047c4a9e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.761545] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7bb082e-1054-4b53-b47b-6d09047c4a9e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.761835] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7bb082e-1054-4b53-b47b-6d09047c4a9e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.762047] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.762181] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.762253] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.762451] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.762544] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.762638] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b7bb082e-1054-4b53-b47b-6d09047c4a9e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.038141] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-663 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.038261] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-663" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.038382] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-663" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.038645] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-663" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.038926] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.039091] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.039206] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.039407] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.039548] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.039762] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1121.039853] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1121.039961] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1121.040113] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1121.040227] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1121.040330] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1121.040459] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1121.059236] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1121.059445] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1121.059527] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1121.059694] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-663" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.060021] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-9af78c5b-be1d-444c-9c31-5e17592bb13e taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.060192] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-9af78c5b-be1d-444c-9c31-5e17592bb13e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.060309] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-9af78c5b-be1d-444c-9c31-5e17592bb13e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.060613] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-9af78c5b-be1d-444c-9c31-5e17592bb13e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.060746] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9af78c5b-be1d-444c-9c31-5e17592bb13e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.267237] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.267237] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.267237] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.267237] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.267237] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.267237] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.267237] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.267237] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.267582] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.267582] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.267582] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7bb082e-1054-4b53-b47b-6d09047c4a9e already deleted. [ 1121.267659] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7bb082e-1054-4b53-b47b-6d09047c4a9e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.563749] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.564077] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.564209] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.564517] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.564685] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.564858] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 9af78c5b-be1d-444c-9c31-5e17592bb13e not found, creating... [ 1121.565164] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.565350] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.565472] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.565729] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.565877] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.566216] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.566411] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.566543] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.566773] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.566915] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.567080] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 9af78c5b-be1d-444c-9c31-5e17592bb13e is going to be created. [ 1121.588292] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.588583] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.588583] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.588818] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.589137] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.589407] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-9af78c5b-be1d-444c-9c31-5e17592bb13e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.275530] env[70764]: INFO networking_nsxv3.common.synchronization [req-736d0108-ed04-4d3d-87be-2e4a30045e04 req-1811e299-475d-47aa-8fb7-4003fb4fb112 service nova] Enqueued Resource ID: b7bb082e-1054-4b53-b47b-6d09047c4a9e with Priority: HIGHEST for action security_group_rules [ 1122.275699] env[70764]: INFO networking_nsxv3.common.synchronization [req-736d0108-ed04-4d3d-87be-2e4a30045e04 req-1811e299-475d-47aa-8fb7-4003fb4fb112 service nova] Enqueued Resource ID: b7bb082e-1054-4b53-b47b-6d09047c4a9e with Priority: HIGHEST for action security_group_members [ 1122.275846] env[70764]: INFO networking_nsxv3.common.synchronization [req-736d0108-ed04-4d3d-87be-2e4a30045e04 req-1811e299-475d-47aa-8fb7-4003fb4fb112 service nova] Enqueued Resource ID: 9af78c5b-be1d-444c-9c31-5e17592bb13e with Priority: HIGHEST for action port [ 1122.276095] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7bb082e-1054-4b53-b47b-6d09047c4a9e with Priority: HIGHEST for action security_group_rules [ 1122.276255] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7bb082e-1054-4b53-b47b-6d09047c4a9e with Priority: HIGHEST for action security_group_members [ 1122.276373] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9af78c5b-be1d-444c-9c31-5e17592bb13e with Priority: HIGHEST for action port [ 1122.277887] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b7bb082e-1054-4b53-b47b-6d09047c4a9e taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.278018] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b7bb082e-1054-4b53-b47b-6d09047c4a9e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.278121] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b7bb082e-1054-4b53-b47b-6d09047c4a9e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.278335] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b7bb082e-1054-4b53-b47b-6d09047c4a9e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.278413] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b7bb082e-1054-4b53-b47b-6d09047c4a9e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.279259] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7bb082e-1054-4b53-b47b-6d09047c4a9e taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.279366] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7bb082e-1054-4b53-b47b-6d09047c4a9e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.279465] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7bb082e-1054-4b53-b47b-6d09047c4a9e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.279593] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7bb082e-1054-4b53-b47b-6d09047c4a9e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.279732] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.279829] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.280529] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.280529] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.280529] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.280529] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b7bb082e-1054-4b53-b47b-6d09047c4a9e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.281800] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-9af78c5b-be1d-444c-9c31-5e17592bb13e taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.281800] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9af78c5b-be1d-444c-9c31-5e17592bb13e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.281947] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9af78c5b-be1d-444c-9c31-5e17592bb13e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.282157] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9af78c5b-be1d-444c-9c31-5e17592bb13e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.282157] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9af78c5b-be1d-444c-9c31-5e17592bb13e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.567288] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01588700-3c33-4723-87f1-c5abc176445e in Status: SUCCESS [ 1122.567618] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.642282] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 90e38802-c5d5-43ce-9d13-c67ca1804885 in Status: SUCCESS [ 1122.642509] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.642677] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.642895] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.642987] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('90e38802-c5d5-43ce-9d13-c67ca1804885',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.784240] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7bb082e-1054-4b53-b47b-6d09047c4a9e taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.784416] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7bb082e-1054-4b53-b47b-6d09047c4a9e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.784591] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b7bb082e-1054-4b53-b47b-6d09047c4a9e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.785557] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9af78c5b-be1d-444c-9c31-5e17592bb13e with status ACTIVE [ 1122.786171] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.786171] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.786171] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.786171] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.786383] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.786453] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.786555] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.786654] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.787993] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.787993] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.787993] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.787993] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.787993] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.787993] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.787993] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.787993] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9af78c5b-be1d-444c-9c31-5e17592bb13e is going to be updated. [ 1122.807542] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.807698] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.807766] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.807962] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.808112] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.808268] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9af78c5b-be1d-444c-9c31-5e17592bb13e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.145184] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-90e38802-c5d5-43ce-9d13-c67ca1804885 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.145339] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.145574] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.145635] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.145780] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.145880] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.145944] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.146222] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.146222] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.146320] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.146380] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('90e38802-c5d5-43ce-9d13-c67ca1804885',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.288872] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b7bb082e-1054-4b53-b47b-6d09047c4a9e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.648285] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-90e38802-c5d5-43ce-9d13-c67ca1804885 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.648575] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.648575] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.648729] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.648902] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.649064] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.649122] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.649241] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.649325] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.649413] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.649627] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-90e38802-c5d5-43ce-9d13-c67ca1804885 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.649682] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.649709] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.649837] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.649970] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.650073] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.650133] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.650315] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.650402] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.650485] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.650573] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('90e38802-c5d5-43ce-9d13-c67ca1804885',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.791716] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.791716] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.791824] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.791997] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.792133] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.792225] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7bb082e-1054-4b53-b47b-6d09047c4a9e is going to be created. [ 1123.815614] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.815614] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.815779] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.815926] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.816323] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.824886] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7bb082e-1054-4b53-b47b-6d09047c4a9e in Status: UNINITIALIZED for 2s [ 1124.153098] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 90e38802-c5d5-43ce-9d13-c67ca1804885: rpc.has_security_group_logging(os_id): False [ 1124.171945] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.172226] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.172319] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.172593] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.172723] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.172967] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.173122] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.173229] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.173434] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.173556] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.173850] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.173961] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.175027] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.175027] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.175027] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.175027] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.175027] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.175027] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.175027] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.175433] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.175433] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 90e38802-c5d5-43ce-9d13-c67ca1804885 is going to be updated. [ 1124.266026] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.266026] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.266026] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.266278] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.266468] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.280259] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 90e38802-c5d5-43ce-9d13-c67ca1804885 in Status: IN_PROGRESS for 2s [ 1125.722200] env[70764]: INFO networking_nsxv3.common.synchronization [req-0ccfd358-c796-47ac-84a4-c424120924c6 req-62c53caa-e50b-4c7a-a665-a79417aaa8cf tempest-ServersNegativeTestJSON-791332416 tempest-ServersNegativeTestJSON-791332416-project-member] Enqueued Resource ID: 01588700-3c33-4723-87f1-c5abc176445e with Priority: HIGHEST for action security_group_members [ 1125.722200] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01588700-3c33-4723-87f1-c5abc176445e with Priority: HIGHEST for action security_group_members [ 1125.722200] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-01588700-3c33-4723-87f1-c5abc176445e taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.722200] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.722200] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.722603] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.722752] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.722870] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.722977] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.723405] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.723528] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.723676] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01588700-3c33-4723-87f1-c5abc176445e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.798995] env[70764]: INFO networking_nsxv3.common.synchronization [req-26a3702f-d680-4334-a6bf-19cc8ad0880a req-c9f96164-6a4b-47ef-8f19-e7333b39af52 tempest-AttachInterfacesTestJSON-1880347664 tempest-AttachInterfacesTestJSON-1880347664-project-member] Enqueued Resource ID: 6df71822-ed7d-4644-87b5-30eb51293fdd with Priority: HIGHEST for action security_group_members [ 1125.798995] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6df71822-ed7d-4644-87b5-30eb51293fdd with Priority: HIGHEST for action security_group_members [ 1125.800171] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-6df71822-ed7d-4644-87b5-30eb51293fdd taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.800171] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6df71822-ed7d-4644-87b5-30eb51293fdd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.800171] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6df71822-ed7d-4644-87b5-30eb51293fdd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.800732] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6df71822-ed7d-4644-87b5-30eb51293fdd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.800901] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.801018] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.801085] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.801330] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.801418] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.801513] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6df71822-ed7d-4644-87b5-30eb51293fdd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.833939] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7bb082e-1054-4b53-b47b-6d09047c4a9e in Status: SUCCESS [ 1125.834968] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7bb082e-1054-4b53-b47b-6d09047c4a9e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.834968] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7bb082e-1054-4b53-b47b-6d09047c4a9e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.834968] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7bb082e-1054-4b53-b47b-6d09047c4a9e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.834968] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.834968] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.834968] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.835252] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.835252] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.835252] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7bb082e-1054-4b53-b47b-6d09047c4a9e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.835334] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b7bb082e-1054-4b53-b47b-6d09047c4a9e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.228265] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01588700-3c33-4723-87f1-c5abc176445e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.252474] env[70764]: INFO networking_nsxv3.common.synchronization [req-10fae962-df91-4bb7-b25c-b503b8589a24 req-fed194ea-00ab-46d2-8044-f0a1b87dcdd6 tempest-ServerDiskConfigTestJSON-1914051978 tempest-ServerDiskConfigTestJSON-1914051978-project-member] Enqueued Resource ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 with Priority: HIGHEST for action security_group_members [ 1126.252564] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 with Priority: HIGHEST for action security_group_members [ 1126.253379] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-56646d46-eb79-4ebc-a596-a5a17716f8e4 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.253379] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.253557] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.254322] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.254322] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.254453] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.254453] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.254604] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.254690] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.254781] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56646d46-eb79-4ebc-a596-a5a17716f8e4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.299084] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 90e38802-c5d5-43ce-9d13-c67ca1804885 in Status: SUCCESS [ 1126.299324] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.303358] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.303551] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.303639] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.303896] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.304043] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.304270] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.304375] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.304439] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.304615] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.304760] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.304760] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6df71822-ed7d-4644-87b5-30eb51293fdd already deleted. [ 1126.304886] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6df71822-ed7d-4644-87b5-30eb51293fdd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.338294] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7bb082e-1054-4b53-b47b-6d09047c4a9e taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.338445] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7bb082e-1054-4b53-b47b-6d09047c4a9e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.338607] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7bb082e-1054-4b53-b47b-6d09047c4a9e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.338801] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7bb082e-1054-4b53-b47b-6d09047c4a9e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.339055] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.339180] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.339248] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.339448] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.339550] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.339679] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7bb082e-1054-4b53-b47b-6d09047c4a9e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.339853] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7bb082e-1054-4b53-b47b-6d09047c4a9e taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.339970] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7bb082e-1054-4b53-b47b-6d09047c4a9e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.340051] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7bb082e-1054-4b53-b47b-6d09047c4a9e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.340195] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7bb082e-1054-4b53-b47b-6d09047c4a9e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.340335] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.340426] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.340518] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.340664] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.340742] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.340826] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7bb082e-1054-4b53-b47b-6d09047c4a9e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.340915] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b7bb082e-1054-4b53-b47b-6d09047c4a9e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.348928] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-822 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.349476] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-822" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.349609] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-822" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.349942] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-822" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.350721] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.350943] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.351082] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.351320] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.351490] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.351711] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1126.351942] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1126.352093] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1126.352260] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1126.352331] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1126.352431] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1126.352571] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1126.369788] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1126.370207] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1126.370207] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1126.370307] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-822" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.371531] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-6b9db88a-2511-453b-95a1-690a5403bdfc taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.371531] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-6b9db88a-2511-453b-95a1-690a5403bdfc" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.371531] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-6b9db88a-2511-453b-95a1-690a5403bdfc" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.371531] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-6b9db88a-2511-453b-95a1-690a5403bdfc" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.371531] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b9db88a-2511-453b-95a1-690a5403bdfc',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.732609] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01588700-3c33-4723-87f1-c5abc176445e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.757363] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.757515] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.757591] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.757809] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.784564] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.784682] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.785074] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.785074] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.785373] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.785538] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.785692] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 is going to be updated. [ 1126.812054] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.812235] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.812235] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.812444] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.812580] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.820241] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 in Status: IN_PROGRESS for 2s [ 1126.844348] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b7bb082e-1054-4b53-b47b-6d09047c4a9e: rpc.has_security_group_logging(os_id): False [ 1126.864344] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.864495] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.864532] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.864742] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.864845] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.865105] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.865223] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.865286] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.865449] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.865529] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.865725] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.865822] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.865888] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.866056] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.866133] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.866350] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.866510] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.866510] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.866644] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.866717] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.866801] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b7bb082e-1054-4b53-b47b-6d09047c4a9e is going to be created. [ 1126.874303] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.874533] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.874681] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.874982] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.875137] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.875305] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 6b9db88a-2511-453b-95a1-690a5403bdfc not found, creating... [ 1126.875654] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.875822] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.875946] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.876198] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.876339] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.876644] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.876789] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.876908] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.877162] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.877304] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.877532] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 6b9db88a-2511-453b-95a1-690a5403bdfc is going to be created. [ 1126.903237] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.903538] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.903730] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.904150] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.904474] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.904797] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-6b9db88a-2511-453b-95a1-690a5403bdfc" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.957157] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.957157] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.957157] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.957157] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.957157] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.968055] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b7bb082e-1054-4b53-b47b-6d09047c4a9e in Status: IN_PROGRESS for 2s [ 1127.237462] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.237631] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.237717] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.237905] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.237994] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.238108] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01588700-3c33-4723-87f1-c5abc176445e is going to be updated. [ 1127.267555] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.267725] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.267795] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.268021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.268378] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.277377] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01588700-3c33-4723-87f1-c5abc176445e in Status: IN_PROGRESS for 2s [ 1127.650099] env[70764]: INFO networking_nsxv3.common.synchronization [req-26a3702f-d680-4334-a6bf-19cc8ad0880a req-603fdd34-f55b-463a-9787-f739d5700238 service nova] Enqueued Resource ID: 6df71822-ed7d-4644-87b5-30eb51293fdd with Priority: HIGHEST for action security_group_rules [ 1127.650210] env[70764]: INFO networking_nsxv3.common.synchronization [req-26a3702f-d680-4334-a6bf-19cc8ad0880a req-603fdd34-f55b-463a-9787-f739d5700238 service nova] Enqueued Resource ID: 6df71822-ed7d-4644-87b5-30eb51293fdd with Priority: HIGHEST for action security_group_members [ 1127.650505] env[70764]: INFO networking_nsxv3.common.synchronization [req-26a3702f-d680-4334-a6bf-19cc8ad0880a req-603fdd34-f55b-463a-9787-f739d5700238 service nova] Enqueued Resource ID: 6b9db88a-2511-453b-95a1-690a5403bdfc with Priority: HIGHEST for action port [ 1127.650739] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6df71822-ed7d-4644-87b5-30eb51293fdd with Priority: HIGHEST for action security_group_rules [ 1127.650950] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6df71822-ed7d-4644-87b5-30eb51293fdd with Priority: HIGHEST for action security_group_members [ 1127.650950] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b9db88a-2511-453b-95a1-690a5403bdfc with Priority: HIGHEST for action port [ 1127.651573] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6df71822-ed7d-4644-87b5-30eb51293fdd taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.651692] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6df71822-ed7d-4644-87b5-30eb51293fdd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.651763] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6df71822-ed7d-4644-87b5-30eb51293fdd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.651971] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6df71822-ed7d-4644-87b5-30eb51293fdd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.652059] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6df71822-ed7d-4644-87b5-30eb51293fdd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.652941] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-6df71822-ed7d-4644-87b5-30eb51293fdd taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.653075] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6df71822-ed7d-4644-87b5-30eb51293fdd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.653212] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6df71822-ed7d-4644-87b5-30eb51293fdd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.653302] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6df71822-ed7d-4644-87b5-30eb51293fdd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.653452] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.653538] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.653591] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.653735] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.653803] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.653927] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6df71822-ed7d-4644-87b5-30eb51293fdd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.654768] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b9db88a-2511-453b-95a1-690a5403bdfc taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.654900] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b9db88a-2511-453b-95a1-690a5403bdfc" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.654991] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b9db88a-2511-453b-95a1-690a5403bdfc" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.655301] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b9db88a-2511-453b-95a1-690a5403bdfc" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.655301] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b9db88a-2511-453b-95a1-690a5403bdfc',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.157563] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6df71822-ed7d-4644-87b5-30eb51293fdd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.157976] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-6df71822-ed7d-4644-87b5-30eb51293fdd taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.157976] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6df71822-ed7d-4644-87b5-30eb51293fdd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.161253] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6b9db88a-2511-453b-95a1-690a5403bdfc with status ACTIVE [ 1128.161253] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.161253] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.161253] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.161253] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.161253] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.161253] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.161253] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.161253] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.161253] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.161253] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.161253] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.161253] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.161253] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.161253] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.161253] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.161253] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6b9db88a-2511-453b-95a1-690a5403bdfc is going to be updated. [ 1128.181054] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.181214] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.181328] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.181499] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.181636] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.181908] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b9db88a-2511-453b-95a1-690a5403bdfc" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.659205] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6df71822-ed7d-4644-87b5-30eb51293fdd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.830422] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 in Status: SUCCESS [ 1128.830422] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 deletion is rescheduled due to dependency. [ 1128.830686] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.979068] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b7bb082e-1054-4b53-b47b-6d09047c4a9e in Status: SUCCESS [ 1128.979408] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b7bb082e-1054-4b53-b47b-6d09047c4a9e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.162317] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.162839] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.162839] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.162839] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.162839] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.162965] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6df71822-ed7d-4644-87b5-30eb51293fdd is going to be created. [ 1129.186501] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.186757] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.186855] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.187109] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.187378] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.198745] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6df71822-ed7d-4644-87b5-30eb51293fdd in Status: UNINITIALIZED for 2s [ 1129.287059] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01588700-3c33-4723-87f1-c5abc176445e in Status: SUCCESS [ 1129.289332] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.209088] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6df71822-ed7d-4644-87b5-30eb51293fdd in Status: SUCCESS [ 1131.209384] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6df71822-ed7d-4644-87b5-30eb51293fdd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.209516] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6df71822-ed7d-4644-87b5-30eb51293fdd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.209730] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6df71822-ed7d-4644-87b5-30eb51293fdd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.209947] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.210104] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.210198] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.210347] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.210482] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.210547] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6df71822-ed7d-4644-87b5-30eb51293fdd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.210634] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6df71822-ed7d-4644-87b5-30eb51293fdd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.712650] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6df71822-ed7d-4644-87b5-30eb51293fdd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.215294] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6df71822-ed7d-4644-87b5-30eb51293fdd: rpc.has_security_group_logging(os_id): False [ 1132.234815] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.235032] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.235094] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.235295] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.235387] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.235639] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.235746] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.235815] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.235964] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.236055] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.236141] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6df71822-ed7d-4644-87b5-30eb51293fdd is going to be created. [ 1132.308019] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.308158] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.308320] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.308433] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.308610] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.321464] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6df71822-ed7d-4644-87b5-30eb51293fdd in Status: IN_PROGRESS for 2s [ 1132.652441] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1132.652616] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1134.335096] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6df71822-ed7d-4644-87b5-30eb51293fdd in Status: SUCCESS [ 1134.335497] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6df71822-ed7d-4644-87b5-30eb51293fdd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.497082] env[70764]: INFO networking_nsxv3.common.synchronization [req-be35e917-b331-419b-890f-2bce5a76246a req-861b2af2-371d-4b71-9d15-d7ab3c537c1b tempest-VolumesAdminNegativeTest-2021792328 tempest-VolumesAdminNegativeTest-2021792328-project-member] Enqueued Resource ID: b7bb082e-1054-4b53-b47b-6d09047c4a9e with Priority: HIGHEST for action security_group_members [ 1135.497082] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7bb082e-1054-4b53-b47b-6d09047c4a9e with Priority: HIGHEST for action security_group_members [ 1135.497082] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7bb082e-1054-4b53-b47b-6d09047c4a9e taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.497955] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7bb082e-1054-4b53-b47b-6d09047c4a9e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.498299] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7bb082e-1054-4b53-b47b-6d09047c4a9e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.498804] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7bb082e-1054-4b53-b47b-6d09047c4a9e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.499287] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.499683] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.499956] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.500529] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.500640] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.501199] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b7bb082e-1054-4b53-b47b-6d09047c4a9e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.005047] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.005047] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.005047] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.005353] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.005353] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.005530] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.005610] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.005671] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.005840] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.005938] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.006041] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7bb082e-1054-4b53-b47b-6d09047c4a9e is going to be updated. [ 1136.033748] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.033908] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.034011] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.034302] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.034458] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.044503] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7bb082e-1054-4b53-b47b-6d09047c4a9e in Status: IN_PROGRESS for 2s [ 1138.072790] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7bb082e-1054-4b53-b47b-6d09047c4a9e in Status: SUCCESS [ 1138.073077] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7bb082e-1054-4b53-b47b-6d09047c4a9e deletion is rescheduled due to dependency. [ 1138.073077] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7bb082e-1054-4b53-b47b-6d09047c4a9e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.132511] env[70764]: INFO networking_nsxv3.common.synchronization [req-96ece365-23f8-4e99-8163-813e31284b93 req-d0a06b80-ef9f-43ff-bd7f-f43358119cad tempest-ServerDiskConfigTestJSON-1914051978 tempest-ServerDiskConfigTestJSON-1914051978-project-member] Enqueued Resource ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 with Priority: HIGHEST for action security_group_members [ 1138.133127] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 with Priority: HIGHEST for action security_group_members [ 1138.133501] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-56646d46-eb79-4ebc-a596-a5a17716f8e4 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.133642] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.133730] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.133945] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.134423] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.134530] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.134594] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.134757] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.134842] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.134937] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56646d46-eb79-4ebc-a596-a5a17716f8e4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.637807] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.638042] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.638163] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.638431] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.638565] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.638801] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.638939] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.639045] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.639246] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.639359] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.639486] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 is going to be updated. [ 1138.664722] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.664809] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.664864] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.665121] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.665272] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.675702] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 in Status: IN_PROGRESS for 2s [ 1138.745666] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-829 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.745830] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-829" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.745968] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-829" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.746296] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-829" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.746844] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.746844] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.746844] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.747088] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.747315] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.747532] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1138.747650] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1138.747763] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1138.747871] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1138.747983] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1138.748104] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1138.748243] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1138.770143] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1138.770335] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1138.770486] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1138.770690] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-829" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.771047] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-bb389d2d-9f27-46fe-a735-1b22f4d673f9 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.771227] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-bb389d2d-9f27-46fe-a735-1b22f4d673f9" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.771349] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-bb389d2d-9f27-46fe-a735-1b22f4d673f9" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.771685] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-bb389d2d-9f27-46fe-a735-1b22f4d673f9" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.771829] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb389d2d-9f27-46fe-a735-1b22f4d673f9',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.276515] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.276815] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.276871] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.277176] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.277334] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.277489] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port bb389d2d-9f27-46fe-a735-1b22f4d673f9 not found, creating... [ 1139.277757] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.277971] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.278043] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.278753] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.278753] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.279139] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.279343] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.280148] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.280148] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.280148] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.280148] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: bb389d2d-9f27-46fe-a735-1b22f4d673f9 is going to be created. [ 1139.301274] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.301490] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.301616] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.301889] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.302147] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.302372] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-bb389d2d-9f27-46fe-a735-1b22f4d673f9" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.088548] env[70764]: INFO networking_nsxv3.common.synchronization [req-96ece365-23f8-4e99-8163-813e31284b93 req-377e37a5-c0bf-4d84-a85a-5e78d2a98a11 service nova] Enqueued Resource ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 with Priority: HIGHEST for action security_group_rules [ 1140.089248] env[70764]: INFO networking_nsxv3.common.synchronization [req-96ece365-23f8-4e99-8163-813e31284b93 req-377e37a5-c0bf-4d84-a85a-5e78d2a98a11 service nova] Enqueued Resource ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 with Priority: HIGHEST for action security_group_members [ 1140.089448] env[70764]: INFO networking_nsxv3.common.synchronization [req-96ece365-23f8-4e99-8163-813e31284b93 req-377e37a5-c0bf-4d84-a85a-5e78d2a98a11 service nova] Enqueued Resource ID: bb389d2d-9f27-46fe-a735-1b22f4d673f9 with Priority: HIGHEST for action port [ 1140.089991] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 with Priority: HIGHEST for action security_group_rules [ 1140.090164] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 with Priority: HIGHEST for action security_group_members [ 1140.090271] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb389d2d-9f27-46fe-a735-1b22f4d673f9 with Priority: HIGHEST for action port [ 1140.090565] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-56646d46-eb79-4ebc-a596-a5a17716f8e4 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.090758] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.090806] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.090983] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.095657] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('56646d46-eb79-4ebc-a596-a5a17716f8e4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.095657] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-56646d46-eb79-4ebc-a596-a5a17716f8e4 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.095657] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.095657] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb389d2d-9f27-46fe-a735-1b22f4d673f9 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.095657] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb389d2d-9f27-46fe-a735-1b22f4d673f9" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.095657] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb389d2d-9f27-46fe-a735-1b22f4d673f9" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.095657] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb389d2d-9f27-46fe-a735-1b22f4d673f9" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.095657] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb389d2d-9f27-46fe-a735-1b22f4d673f9',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.594997] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-56646d46-eb79-4ebc-a596-a5a17716f8e4 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.595326] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.595510] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bb389d2d-9f27-46fe-a735-1b22f4d673f9 with status ACTIVE [ 1140.595737] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.596413] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.596491] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.596703] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.596795] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.596973] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.597154] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.597154] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.597406] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.597489] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.597671] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.597774] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.597820] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.597964] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.598047] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.598127] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bb389d2d-9f27-46fe-a735-1b22f4d673f9 is going to be updated. [ 1140.618805] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.618805] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.618805] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.619041] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.619122] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.619281] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb389d2d-9f27-46fe-a735-1b22f4d673f9" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.685177] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 in Status: SUCCESS [ 1140.685434] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 deletion is rescheduled due to dependency. [ 1140.685581] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.685788] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.686052] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.686312] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.686449] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.686532] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.686750] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.686862] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.687012] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56646d46-eb79-4ebc-a596-a5a17716f8e4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.189527] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('56646d46-eb79-4ebc-a596-a5a17716f8e4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.692064] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('56646d46-eb79-4ebc-a596-a5a17716f8e4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.196295] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.196295] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.196295] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.196295] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.196295] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.196295] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 is going to be updated. [ 1142.224864] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.224864] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.224864] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.224864] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.224864] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.231814] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 in Status: IN_PROGRESS for 2s [ 1142.465523] env[70764]: INFO networking_nsxv3.common.synchronization [req-115fa476-7baa-412b-a209-2c246126a074 req-3d713a37-6e09-4a48-91ac-1b5ab1f6faa9 tempest-DeleteServersTestJSON-1788501793 tempest-DeleteServersTestJSON-1788501793-project-member] Enqueued Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGHEST for action security_group_members [ 1142.466042] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGHEST for action security_group_members [ 1142.466355] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-3379805b-13ae-4057-9511-570e8b3c2437 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.466534] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.466581] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.466750] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.466924] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.470273] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.470273] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.470273] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.470273] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.470443] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3379805b-13ae-4057-9511-570e8b3c2437',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.494913] env[70764]: INFO networking_nsxv3.common.synchronization [req-22e94719-fa32-4106-b32c-26d383092737 req-34b3d2e0-0cc5-47b5-88e1-bb262ab7a75c tempest-ServerActionsTestOtherB-1188510512 tempest-ServerActionsTestOtherB-1188510512-project-member] Enqueued Resource ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b with Priority: HIGHEST for action security_group_members [ 1142.496036] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b with Priority: HIGHEST for action security_group_members [ 1142.496474] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.496604] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.496669] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.496864] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.497017] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.497227] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.497297] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.497557] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.497741] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.497848] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.975795] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.976172] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.976172] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.976496] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.976768] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.976948] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.977133] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.977242] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.977479] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.977603] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.977700] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3379805b-13ae-4057-9511-570e8b3c2437 is going to be updated. [ 1143.001163] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.001163] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.001163] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.001163] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.001163] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.001558] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.001558] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.001558] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.001689] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.001689] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.001772] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b is going to be updated. [ 1143.019430] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.019576] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.019648] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.019854] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.019994] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.029960] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3379805b-13ae-4057-9511-570e8b3c2437 in Status: IN_PROGRESS for 2s [ 1143.032612] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.032806] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.032913] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.033159] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.033305] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.040088] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b in Status: IN_PROGRESS for 2s [ 1143.511035] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-974 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.511439] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-974" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.511439] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-974" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.511731] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-974" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.512041] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.520364] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.520364] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.520364] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.520364] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.520364] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1143.520364] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1143.520364] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1143.520364] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1143.520364] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1143.520364] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1143.520364] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1143.546350] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1143.546350] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1143.546350] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1143.546350] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-974" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.546350] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-32abca0e-d9b5-4317-b7c9-c17eff1c8012 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.546350] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-32abca0e-d9b5-4317-b7c9-c17eff1c8012" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.546350] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-32abca0e-d9b5-4317-b7c9-c17eff1c8012" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.546350] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-32abca0e-d9b5-4317-b7c9-c17eff1c8012" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.546350] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32abca0e-d9b5-4317-b7c9-c17eff1c8012',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.612580] env[70764]: INFO networking_nsxv3.common.synchronization [req-1d808ecb-1e7a-4a58-b4ef-37fff65f9e76 req-70133174-52c8-4128-a96a-9f8c7218f1d2 tempest-AttachVolumeNegativeTest-232785497 tempest-AttachVolumeNegativeTest-232785497-project-member] Enqueued Resource ID: 433d7528-b29b-4b58-848d-9e981ea88344 with Priority: HIGHEST for action security_group_members [ 1143.612580] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 433d7528-b29b-4b58-848d-9e981ea88344 with Priority: HIGHEST for action security_group_members [ 1143.612797] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-433d7528-b29b-4b58-848d-9e981ea88344 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.612914] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-433d7528-b29b-4b58-848d-9e981ea88344" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.612985] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-433d7528-b29b-4b58-848d-9e981ea88344" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.613211] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-433d7528-b29b-4b58-848d-9e981ea88344" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.613372] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.613473] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.613527] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.613670] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.613752] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.613845] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('433d7528-b29b-4b58-848d-9e981ea88344',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.047332] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.047740] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.047740] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.047974] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.048142] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.048318] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 32abca0e-d9b5-4317-b7c9-c17eff1c8012 not found, creating... [ 1144.048605] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.048836] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.049041] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.049277] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.049532] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.049727] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.049887] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.050014] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.050274] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.050480] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.050665] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 32abca0e-d9b5-4317-b7c9-c17eff1c8012 is going to be created. [ 1144.068573] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.068796] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.068923] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.069234] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.069491] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.069737] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-32abca0e-d9b5-4317-b7c9-c17eff1c8012" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.116119] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.116290] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.116368] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.116577] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.141469] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.141753] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.141880] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.142088] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.142175] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.142268] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.142362] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 433d7528-b29b-4b58-848d-9e981ea88344 is going to be updated. [ 1144.184411] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.184411] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.184411] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.184634] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.184927] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.205968] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 433d7528-b29b-4b58-848d-9e981ea88344 in Status: IN_PROGRESS for 2s [ 1144.247170] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 in Status: SUCCESS [ 1144.247307] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.247487] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.247741] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.247942] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.248072] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.248150] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.248341] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.248444] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.248531] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.248669] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('56646d46-eb79-4ebc-a596-a5a17716f8e4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.751312] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-56646d46-eb79-4ebc-a596-a5a17716f8e4 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.751428] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.751428] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.751632] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.751795] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.751892] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.751958] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.752135] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.752235] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.752322] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.752468] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-56646d46-eb79-4ebc-a596-a5a17716f8e4 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.752560] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.752620] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.752758] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.753054] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.753054] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.753054] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.753194] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.753264] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.753324] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.753412] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('56646d46-eb79-4ebc-a596-a5a17716f8e4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.039359] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3379805b-13ae-4057-9511-570e8b3c2437 in Status: SUCCESS [ 1145.039579] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3379805b-13ae-4057-9511-570e8b3c2437 deletion is rescheduled due to dependency. [ 1145.039697] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.047011] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b in Status: SUCCESS [ 1145.047181] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b deletion is rescheduled due to dependency. [ 1145.047296] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.124634] env[70764]: INFO networking_nsxv3.common.synchronization [req-115fa476-7baa-412b-a209-2c246126a074 req-1cc650b3-6772-40dc-b16a-cad0e3b182f5 service nova] Enqueued Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGHEST for action security_group_rules [ 1145.124940] env[70764]: INFO networking_nsxv3.common.synchronization [req-115fa476-7baa-412b-a209-2c246126a074 req-1cc650b3-6772-40dc-b16a-cad0e3b182f5 service nova] Enqueued Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGHEST for action security_group_members [ 1145.124940] env[70764]: INFO networking_nsxv3.common.synchronization [req-115fa476-7baa-412b-a209-2c246126a074 req-1cc650b3-6772-40dc-b16a-cad0e3b182f5 service nova] Enqueued Resource ID: 32abca0e-d9b5-4317-b7c9-c17eff1c8012 with Priority: HIGHEST for action port [ 1145.125227] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGHEST for action security_group_rules [ 1145.125350] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGHEST for action security_group_members [ 1145.125454] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32abca0e-d9b5-4317-b7c9-c17eff1c8012 with Priority: HIGHEST for action port [ 1145.126123] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3379805b-13ae-4057-9511-570e8b3c2437 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.126278] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.126348] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.126550] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.126630] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3379805b-13ae-4057-9511-570e8b3c2437',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.127859] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-3379805b-13ae-4057-9511-570e8b3c2437 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.128028] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.128109] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.128316] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.128474] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.128588] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.128648] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.128801] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.128884] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.128973] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3379805b-13ae-4057-9511-570e8b3c2437',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.133031] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-32abca0e-d9b5-4317-b7c9-c17eff1c8012 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.133031] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32abca0e-d9b5-4317-b7c9-c17eff1c8012" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.133031] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32abca0e-d9b5-4317-b7c9-c17eff1c8012" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.133031] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32abca0e-d9b5-4317-b7c9-c17eff1c8012" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.133031] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32abca0e-d9b5-4317-b7c9-c17eff1c8012',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.256051] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 56646d46-eb79-4ebc-a596-a5a17716f8e4: rpc.has_security_group_logging(os_id): False [ 1145.274400] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.274539] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.274596] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.274782] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.274871] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.275095] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.275199] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.275255] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.275411] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.275487] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.275665] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.275760] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.275860] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.275954] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.276109] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.276368] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.276513] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.276581] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.276727] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.276805] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.276892] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 is going to be updated. [ 1145.365379] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.365379] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.365379] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.365379] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.365379] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.378224] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 in Status: IN_PROGRESS for 2s [ 1145.430021] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-175 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.430021] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-175" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.430021] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-175" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.430021] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-175" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.430609] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.430938] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.431177] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.434027] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.434027] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.434027] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1145.434027] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1145.434027] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1145.434027] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1145.434027] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1145.434027] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1145.434027] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1145.469706] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1145.469890] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1145.470048] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1145.470231] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-175" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.470586] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-9276c3db-e288-4ce3-89dd-a7dbb100ebbb taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.470801] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-9276c3db-e288-4ce3-89dd-a7dbb100ebbb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.470891] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-9276c3db-e288-4ce3-89dd-a7dbb100ebbb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.471104] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-9276c3db-e288-4ce3-89dd-a7dbb100ebbb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.471245] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9276c3db-e288-4ce3-89dd-a7dbb100ebbb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.629020] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-3379805b-13ae-4057-9511-570e8b3c2437 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.629256] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.630659] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3379805b-13ae-4057-9511-570e8b3c2437',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.634460] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 32abca0e-d9b5-4317-b7c9-c17eff1c8012 with status ACTIVE [ 1145.634713] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.634882] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.634960] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.635242] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.635385] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.635679] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.635812] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.635890] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.636121] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.636210] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.636442] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.636543] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.636604] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.636810] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.636884] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.636979] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 32abca0e-d9b5-4317-b7c9-c17eff1c8012 is going to be updated. [ 1145.656872] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.657062] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.657174] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.657787] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.657787] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.657907] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32abca0e-d9b5-4317-b7c9-c17eff1c8012" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.975269] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.975617] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.975805] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.976238] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.976470] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.976908] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.977173] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.977333] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.977663] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.977989] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.978463] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.978722] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.978901] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.979224] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.979434] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.979646] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 9276c3db-e288-4ce3-89dd-a7dbb100ebbb is going to be updated. [ 1146.003393] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.003671] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.003671] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.003946] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.004232] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.004481] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-9276c3db-e288-4ce3-89dd-a7dbb100ebbb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.133371] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3379805b-13ae-4057-9511-570e8b3c2437',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.216492] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 433d7528-b29b-4b58-848d-9e981ea88344 in Status: SUCCESS [ 1146.216697] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 433d7528-b29b-4b58-848d-9e981ea88344 deletion is rescheduled due to dependency. [ 1146.216813] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-433d7528-b29b-4b58-848d-9e981ea88344" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.636202] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.636351] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.636437] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.636691] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.636783] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.636904] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3379805b-13ae-4057-9511-570e8b3c2437 is going to be updated. [ 1146.662965] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.663133] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.663208] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.663422] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.663565] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.671676] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3379805b-13ae-4057-9511-570e8b3c2437 in Status: IN_PROGRESS for 2s [ 1147.010543] env[70764]: INFO networking_nsxv3.common.synchronization [req-d34d20f4-973b-4f10-8a47-b4b34b79841d req-3a75bfc9-7095-48ee-8795-45dd5de0dd72 service nova] Enqueued Resource ID: 4e505537-e930-46b3-bee1-b6cba5260d3d with Priority: HIGHEST for action security_group_rules [ 1147.010543] env[70764]: INFO networking_nsxv3.common.synchronization [req-d34d20f4-973b-4f10-8a47-b4b34b79841d req-3a75bfc9-7095-48ee-8795-45dd5de0dd72 service nova] Enqueued Resource ID: 4e505537-e930-46b3-bee1-b6cba5260d3d with Priority: HIGHEST for action security_group_members [ 1147.010543] env[70764]: INFO networking_nsxv3.common.synchronization [req-d34d20f4-973b-4f10-8a47-b4b34b79841d req-3a75bfc9-7095-48ee-8795-45dd5de0dd72 service nova] Enqueued Resource ID: 9276c3db-e288-4ce3-89dd-a7dbb100ebbb with Priority: HIGHEST for action port [ 1147.010749] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e505537-e930-46b3-bee1-b6cba5260d3d with Priority: HIGHEST for action security_group_rules [ 1147.010813] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e505537-e930-46b3-bee1-b6cba5260d3d with Priority: HIGHEST for action security_group_members [ 1147.010897] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9276c3db-e288-4ce3-89dd-a7dbb100ebbb with Priority: HIGHEST for action port [ 1147.011316] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e505537-e930-46b3-bee1-b6cba5260d3d taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.011445] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.011511] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.011705] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.011786] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e505537-e930-46b3-bee1-b6cba5260d3d',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.012856] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e505537-e930-46b3-bee1-b6cba5260d3d taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.012856] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.012856] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.013051] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.015459] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.015599] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.015696] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.015856] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.015997] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.016083] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e505537-e930-46b3-bee1-b6cba5260d3d',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.017375] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-9276c3db-e288-4ce3-89dd-a7dbb100ebbb taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.017506] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9276c3db-e288-4ce3-89dd-a7dbb100ebbb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.017582] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9276c3db-e288-4ce3-89dd-a7dbb100ebbb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.017850] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9276c3db-e288-4ce3-89dd-a7dbb100ebbb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.017952] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9276c3db-e288-4ce3-89dd-a7dbb100ebbb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.395794] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 in Status: SUCCESS [ 1147.396104] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.517668] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e505537-e930-46b3-bee1-b6cba5260d3d',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.519542] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9276c3db-e288-4ce3-89dd-a7dbb100ebbb with status ACTIVE [ 1147.519808] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.519910] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.519984] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.520223] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.520294] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.520486] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.520606] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.520671] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.520851] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.521180] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.521180] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.521267] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.521297] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.521445] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.521535] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.521623] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9276c3db-e288-4ce3-89dd-a7dbb100ebbb is going to be updated. [ 1147.523466] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e505537-e930-46b3-bee1-b6cba5260d3d taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.524165] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.543837] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.544087] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.544217] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.544402] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.544539] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.544702] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9276c3db-e288-4ce3-89dd-a7dbb100ebbb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.020046] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e505537-e930-46b3-bee1-b6cba5260d3d',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.522328] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.522695] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.522695] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.522774] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.522869] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.522970] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e505537-e930-46b3-bee1-b6cba5260d3d is going to be updated. [ 1148.531106] env[70764]: INFO networking_nsxv3.common.synchronization [req-a7afa8ed-be21-4518-bcfb-355e4c9b4b6b req-6d4ada0e-0f28-4b4e-bdb4-4809f6492366 tempest-ServerActionsTestJSON-288318646 tempest-ServerActionsTestJSON-288318646-project-member] Enqueued Resource ID: 10a6cc00-1953-4c0f-8a12-c0405294ba0f with Priority: HIGHEST for action security_group_members [ 1148.533026] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10a6cc00-1953-4c0f-8a12-c0405294ba0f with Priority: HIGHEST for action security_group_members [ 1148.534161] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-10a6cc00-1953-4c0f-8a12-c0405294ba0f taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.534706] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10a6cc00-1953-4c0f-8a12-c0405294ba0f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.534824] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10a6cc00-1953-4c0f-8a12-c0405294ba0f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.535068] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10a6cc00-1953-4c0f-8a12-c0405294ba0f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.535240] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.535452] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.535527] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.535707] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.535832] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.535989] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10a6cc00-1953-4c0f-8a12-c0405294ba0f',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.557302] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.557465] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.557528] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.557746] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.557887] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.566524] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e505537-e930-46b3-bee1-b6cba5260d3d in Status: IN_PROGRESS for 2s [ 1148.680409] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3379805b-13ae-4057-9511-570e8b3c2437 in Status: SUCCESS [ 1148.680631] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.680787] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.681021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.681220] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.681371] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.681429] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.681551] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.681626] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.681709] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.681802] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3379805b-13ae-4057-9511-570e8b3c2437',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.041426] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.041426] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.041426] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.041426] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.063532] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.063532] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.063532] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.063532] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.063532] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.063532] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.063532] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10a6cc00-1953-4c0f-8a12-c0405294ba0f is going to be updated. [ 1149.088966] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.088966] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.088966] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.088966] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.088966] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.095826] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10a6cc00-1953-4c0f-8a12-c0405294ba0f in Status: IN_PROGRESS for 2s [ 1149.187172] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-3379805b-13ae-4057-9511-570e8b3c2437 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.187172] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.187172] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.187541] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.187763] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.187909] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.190578] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.190578] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.190578] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.190578] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.190578] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-3379805b-13ae-4057-9511-570e8b3c2437 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.190578] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.190578] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.190578] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.190578] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.190578] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.190578] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.190578] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.190578] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.190578] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.190578] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3379805b-13ae-4057-9511-570e8b3c2437',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.693204] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3379805b-13ae-4057-9511-570e8b3c2437: rpc.has_security_group_logging(os_id): False [ 1149.711767] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.711962] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.712025] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.712348] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.712445] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.712694] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.712811] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.712877] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.713068] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.713155] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.713356] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.713456] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.713520] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.713661] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.713734] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.713955] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.714069] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.714130] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.714323] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.714399] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.714502] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3379805b-13ae-4057-9511-570e8b3c2437 is going to be updated. [ 1149.778793] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.778958] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.779075] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.779273] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.779419] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.798987] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3379805b-13ae-4057-9511-570e8b3c2437 in Status: IN_PROGRESS for 2s [ 1150.575988] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e505537-e930-46b3-bee1-b6cba5260d3d in Status: SUCCESS [ 1150.576260] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.576446] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.576706] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.576897] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.577194] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.577194] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.577289] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.577336] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.577455] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.577529] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4e505537-e930-46b3-bee1-b6cba5260d3d',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.079656] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4e505537-e930-46b3-bee1-b6cba5260d3d',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.105469] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10a6cc00-1953-4c0f-8a12-c0405294ba0f in Status: IN_PROGRESS for 4s [ 1151.353037] env[70764]: INFO networking_nsxv3.common.synchronization [req-7182d54a-5dc4-49df-abba-eab0cb355bc9 req-4105f711-a652-4cff-a954-cfa42d025dc8 tempest-ServerDiskConfigTestJSON-1914051978 tempest-ServerDiskConfigTestJSON-1914051978-project-member] Enqueued Resource ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 with Priority: HIGHEST for action security_group_members [ 1151.353698] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 with Priority: HIGHEST for action security_group_members [ 1151.354139] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-56646d46-eb79-4ebc-a596-a5a17716f8e4 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.354373] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.354509] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.355598] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.355598] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.355598] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.355598] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.355598] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.355598] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.355598] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56646d46-eb79-4ebc-a596-a5a17716f8e4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.581616] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4e505537-e930-46b3-bee1-b6cba5260d3d: rpc.has_security_group_logging(os_id): False [ 1151.599195] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.599385] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.599385] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.599588] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.599683] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.599932] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.600049] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.600115] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.600262] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.600338] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.600422] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e505537-e930-46b3-bee1-b6cba5260d3d is going to be updated. [ 1151.634941] env[70764]: INFO networking_nsxv3.common.synchronization [req-c37bf660-86f8-4c44-8285-70e637920be9 req-f7511b26-6eb3-4fe5-9103-2d7053578f2a tempest-VolumesAdminNegativeTest-2021792328 tempest-VolumesAdminNegativeTest-2021792328-project-member] Enqueued Resource ID: 025fa550-df80-4c1b-a8f7-f75221e3bef7 with Priority: HIGHEST for action security_group_members [ 1151.635299] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 025fa550-df80-4c1b-a8f7-f75221e3bef7 with Priority: HIGHEST for action security_group_members [ 1151.635603] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-025fa550-df80-4c1b-a8f7-f75221e3bef7 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.635733] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-025fa550-df80-4c1b-a8f7-f75221e3bef7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.635794] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-025fa550-df80-4c1b-a8f7-f75221e3bef7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.637245] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-025fa550-df80-4c1b-a8f7-f75221e3bef7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.637245] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.637245] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.637245] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.637490] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.637490] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.637557] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('025fa550-df80-4c1b-a8f7-f75221e3bef7',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.655478] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.655629] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.655721] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.655924] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.656089] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.671024] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e505537-e930-46b3-bee1-b6cba5260d3d in Status: IN_PROGRESS for 2s [ 1151.813060] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3379805b-13ae-4057-9511-570e8b3c2437 in Status: SUCCESS [ 1151.813271] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.858083] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.858237] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.858315] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.858590] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.858690] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.858887] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.858993] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.859068] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.859230] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.859339] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.859455] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 is going to be updated. [ 1151.886039] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.886039] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.886289] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.886321] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.886456] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.894084] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 in Status: IN_PROGRESS for 2s [ 1152.140427] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.140711] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.140783] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.141047] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.163633] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.163906] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.164310] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.164460] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.164707] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.164926] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.165117] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 025fa550-df80-4c1b-a8f7-f75221e3bef7 is going to be updated. [ 1152.208085] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.208284] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.208360] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.209064] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.209224] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.217359] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 025fa550-df80-4c1b-a8f7-f75221e3bef7 in Status: IN_PROGRESS for 2s [ 1152.320351] env[70764]: INFO networking_nsxv3.common.synchronization [req-4926fcce-5ebf-499e-8e77-9d7d544f3718 req-fef96c7a-cca9-42e3-a7da-1eb963c6c8d0 tempest-ServerActionsTestOtherB-1188510512 tempest-ServerActionsTestOtherB-1188510512-project-member] Enqueued Resource ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b with Priority: HIGHEST for action security_group_members [ 1152.320351] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b with Priority: HIGHEST for action security_group_members [ 1152.320642] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.320928] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.320928] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.321178] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.321371] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.321491] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.321557] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.321722] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.321983] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.321983] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.740030] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-853 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.740030] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-853" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.740312] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-853" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.740448] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-853" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.740709] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.740876] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.740998] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.741229] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.741378] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.741590] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1152.741747] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1152.741817] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1152.741931] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1152.742056] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1152.742229] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1152.742388] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1152.758857] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1152.759033] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1152.759179] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1152.759362] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-853" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.759678] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-d7074955-656a-47b0-bbea-8482e2e15cb1 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.759855] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-d7074955-656a-47b0-bbea-8482e2e15cb1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.759977] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-d7074955-656a-47b0-bbea-8482e2e15cb1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.760341] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-d7074955-656a-47b0-bbea-8482e2e15cb1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.760489] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7074955-656a-47b0-bbea-8482e2e15cb1',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.824300] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.824485] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.824556] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.824832] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.824928] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.825148] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.825286] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.825405] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.825538] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.825599] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.825689] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b is going to be updated. [ 1152.850616] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.850765] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.850837] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.851066] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.851216] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.860133] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b in Status: IN_PROGRESS for 2s [ 1153.121288] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10a6cc00-1953-4c0f-8a12-c0405294ba0f in Status: SUCCESS [ 1153.121449] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10a6cc00-1953-4c0f-8a12-c0405294ba0f deletion is rescheduled due to dependency. [ 1153.121598] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10a6cc00-1953-4c0f-8a12-c0405294ba0f" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.263060] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.263516] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.263564] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.264032] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.264178] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.264287] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port d7074955-656a-47b0-bbea-8482e2e15cb1 not found, creating... [ 1153.264570] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.264716] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.264837] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.265100] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.265245] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.265557] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.265699] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.265830] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.266055] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.266192] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.266336] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: d7074955-656a-47b0-bbea-8482e2e15cb1 is going to be created. [ 1153.287498] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.287498] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.287498] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.287498] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.287498] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.287948] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-d7074955-656a-47b0-bbea-8482e2e15cb1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.684351] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e505537-e930-46b3-bee1-b6cba5260d3d in Status: SUCCESS [ 1153.684595] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.905851] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 in Status: SUCCESS [ 1153.906047] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56646d46-eb79-4ebc-a596-a5a17716f8e4 deletion is rescheduled due to dependency. [ 1153.906162] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56646d46-eb79-4ebc-a596-a5a17716f8e4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.106960] env[70764]: INFO networking_nsxv3.common.synchronization [req-4926fcce-5ebf-499e-8e77-9d7d544f3718 req-03697bbd-f68a-4770-9b62-bd3ab305ce1a service nova] Enqueued Resource ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b with Priority: HIGHEST for action security_group_rules [ 1154.107161] env[70764]: INFO networking_nsxv3.common.synchronization [req-4926fcce-5ebf-499e-8e77-9d7d544f3718 req-03697bbd-f68a-4770-9b62-bd3ab305ce1a service nova] Enqueued Resource ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b with Priority: HIGHEST for action security_group_members [ 1154.107307] env[70764]: INFO networking_nsxv3.common.synchronization [req-4926fcce-5ebf-499e-8e77-9d7d544f3718 req-03697bbd-f68a-4770-9b62-bd3ab305ce1a service nova] Enqueued Resource ID: d7074955-656a-47b0-bbea-8482e2e15cb1 with Priority: HIGHEST for action port [ 1154.107538] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b with Priority: HIGHEST for action security_group_rules [ 1154.107665] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b with Priority: HIGHEST for action security_group_members [ 1154.107764] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7074955-656a-47b0-bbea-8482e2e15cb1 with Priority: HIGHEST for action port [ 1154.110117] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.110117] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.110117] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.110117] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.110117] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.110117] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.110117] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.110448] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7074955-656a-47b0-bbea-8482e2e15cb1 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.110448] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7074955-656a-47b0-bbea-8482e2e15cb1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.110448] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7074955-656a-47b0-bbea-8482e2e15cb1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.112148] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7074955-656a-47b0-bbea-8482e2e15cb1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.112148] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7074955-656a-47b0-bbea-8482e2e15cb1',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.235290] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 025fa550-df80-4c1b-a8f7-f75221e3bef7 in Status: SUCCESS [ 1154.235630] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 025fa550-df80-4c1b-a8f7-f75221e3bef7 deletion is rescheduled due to dependency. [ 1154.235839] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-025fa550-df80-4c1b-a8f7-f75221e3bef7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.613153] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.613153] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.613153] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d7074955-656a-47b0-bbea-8482e2e15cb1 with status ACTIVE [ 1154.613534] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.613534] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.613534] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.613667] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.613700] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.613853] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.613971] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.614037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.614163] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.614272] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.614475] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.614573] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.614632] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.614771] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.614844] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.614928] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d7074955-656a-47b0-bbea-8482e2e15cb1 is going to be updated. [ 1154.635199] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.635199] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.635376] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.635586] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.635785] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.636060] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7074955-656a-47b0-bbea-8482e2e15cb1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.869463] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b in Status: SUCCESS [ 1154.869639] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b deletion is rescheduled due to dependency. [ 1154.869753] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.869899] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.870120] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.870306] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.870420] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.870485] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.870633] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.870711] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.870804] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.374124] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.876687] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.378945] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.379158] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.379231] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.379450] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.379543] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.379660] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b is going to be updated. [ 1156.410064] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.410257] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.410325] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.410567] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.410751] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.419762] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b in Status: IN_PROGRESS for 2s [ 1158.430595] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b in Status: SUCCESS [ 1158.430860] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.431038] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.431281] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.431495] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.431619] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.431684] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.431847] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.431932] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.432041] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.432636] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.935505] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.108464] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1159.108578] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1159.438962] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b: rpc.has_security_group_logging(os_id): False [ 1159.456701] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.456875] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.456949] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.457174] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.457265] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.457508] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.458128] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.458128] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.458128] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.458734] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.458734] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b is going to be updated. [ 1159.516957] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.517129] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.517202] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.517412] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.517554] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.536685] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b in Status: IN_PROGRESS for 2s [ 1161.343396] env[70764]: INFO networking_nsxv3.common.synchronization [None req-2a09c806-882a-49f1-a337-f3c247a5ac07 None None] Enqueued Resource ID: f036ff85-03c6-42fa-98ac-4c4ef0dc1918 with Priority: HIGHEST for action port [ 1161.343668] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f036ff85-03c6-42fa-98ac-4c4ef0dc1918 with Priority: HIGHEST for action port [ 1161.344222] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-f036ff85-03c6-42fa-98ac-4c4ef0dc1918 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.344393] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f036ff85-03c6-42fa-98ac-4c4ef0dc1918" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.344468] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f036ff85-03c6-42fa-98ac-4c4ef0dc1918" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.344722] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f036ff85-03c6-42fa-98ac-4c4ef0dc1918" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.344821] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f036ff85-03c6-42fa-98ac-4c4ef0dc1918',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.553318] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b in Status: SUCCESS [ 1161.553571] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.850463] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f036ff85-03c6-42fa-98ac-4c4ef0dc1918 [ 1161.850716] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.850938] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.851097] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.851425] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.851425] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.851579] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f036ff85-03c6-42fa-98ac-4c4ef0dc1918 already deleted. [ 1161.851643] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f036ff85-03c6-42fa-98ac-4c4ef0dc1918" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.841881] env[70764]: INFO networking_nsxv3.common.synchronization [None req-938d8ada-ffb1-4bd6-bd21-be7ed9017f84 None None] Enqueued Resource ID: 4fc4994b-13b2-4624-9be6-b67e9238ce0e with Priority: HIGHEST for action port [ 1163.841881] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fc4994b-13b2-4624-9be6-b67e9238ce0e with Priority: HIGHEST for action port [ 1163.845572] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-4fc4994b-13b2-4624-9be6-b67e9238ce0e taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.847446] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4fc4994b-13b2-4624-9be6-b67e9238ce0e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.847446] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4fc4994b-13b2-4624-9be6-b67e9238ce0e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.847446] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4fc4994b-13b2-4624-9be6-b67e9238ce0e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.847446] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4fc4994b-13b2-4624-9be6-b67e9238ce0e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.351508] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4fc4994b-13b2-4624-9be6-b67e9238ce0e [ 1164.352178] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.352178] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.352178] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.352489] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.352489] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.352489] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4fc4994b-13b2-4624-9be6-b67e9238ce0e already deleted. [ 1164.352639] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4fc4994b-13b2-4624-9be6-b67e9238ce0e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.407686] env[70764]: INFO networking_nsxv3.common.synchronization [None req-d46979ec-c07b-4da2-ae2b-86aad5f887f4 None None] Enqueued Resource ID: 7cab382a-5c63-42ce-9e08-e4f36d713e96 with Priority: HIGHEST for action port [ 1166.411066] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cab382a-5c63-42ce-9e08-e4f36d713e96 with Priority: HIGHEST for action port [ 1166.411066] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-7cab382a-5c63-42ce-9e08-e4f36d713e96 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.411066] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7cab382a-5c63-42ce-9e08-e4f36d713e96" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.411066] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7cab382a-5c63-42ce-9e08-e4f36d713e96" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.411066] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7cab382a-5c63-42ce-9e08-e4f36d713e96" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.411066] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7cab382a-5c63-42ce-9e08-e4f36d713e96',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.916667] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7cab382a-5c63-42ce-9e08-e4f36d713e96 [ 1166.916667] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.916667] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.916667] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.916667] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.916667] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.916667] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7cab382a-5c63-42ce-9e08-e4f36d713e96 already deleted. [ 1166.916667] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7cab382a-5c63-42ce-9e08-e4f36d713e96" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.026299] env[70764]: INFO networking_nsxv3.common.synchronization [req-7629cd4f-ce9c-4796-95e1-1b480e0f47ff req-bd01f053-a797-460e-9c71-ef7c373d2dd6 tempest-MultipleCreateTestJSON-132917574 tempest-MultipleCreateTestJSON-132917574-project-member] Enqueued Resource ID: 12f4761e-3f37-4705-a034-61d725eca2f4 with Priority: HIGHEST for action security_group_members [ 1168.026853] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12f4761e-3f37-4705-a034-61d725eca2f4 with Priority: HIGHEST for action security_group_members [ 1168.027260] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-12f4761e-3f37-4705-a034-61d725eca2f4 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.027414] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.027414] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.027691] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.027860] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.027968] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.028048] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.028277] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.028277] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.028381] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12f4761e-3f37-4705-a034-61d725eca2f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.327296] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-153 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.327523] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-153" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.331020] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-153" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.331020] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-153" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.331020] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.331020] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.331020] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.331020] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.331020] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.331020] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1168.331020] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1168.331020] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1168.331020] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1168.331020] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1168.331020] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1168.331020] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1168.350259] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1168.350557] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1168.351543] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1168.351543] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-153" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.351543] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-92cdcd51-3eaa-4c9b-817e-7acac6a70668 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.352140] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-92cdcd51-3eaa-4c9b-817e-7acac6a70668" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.352140] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-92cdcd51-3eaa-4c9b-817e-7acac6a70668" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.352597] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-92cdcd51-3eaa-4c9b-817e-7acac6a70668" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.353224] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92cdcd51-3eaa-4c9b-817e-7acac6a70668',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.530270] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.530531] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.530531] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.530661] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.530777] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.531054] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.531169] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.531169] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.531404] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.531481] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.531536] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12f4761e-3f37-4705-a034-61d725eca2f4 already deleted. [ 1168.531583] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.681361] env[70764]: INFO networking_nsxv3.common.synchronization [None req-43b72777-3723-40b4-8ba1-0d9eb6194c45 None None] Enqueued Resource ID: a8e68dbd-cf00-4b4f-9e45-bc68584b5a72 with Priority: HIGHEST for action port [ 1168.681919] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8e68dbd-cf00-4b4f-9e45-bc68584b5a72 with Priority: HIGHEST for action port [ 1168.682240] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8e68dbd-cf00-4b4f-9e45-bc68584b5a72 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.682358] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8e68dbd-cf00-4b4f-9e45-bc68584b5a72" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.682431] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8e68dbd-cf00-4b4f-9e45-bc68584b5a72" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.682689] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8e68dbd-cf00-4b4f-9e45-bc68584b5a72" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.682773] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8e68dbd-cf00-4b4f-9e45-bc68584b5a72',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.855346] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.855686] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.855822] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.856122] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.856304] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.856494] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 92cdcd51-3eaa-4c9b-817e-7acac6a70668 not found, creating... [ 1168.856816] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.856988] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.857121] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.857339] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.857495] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.857776] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.857935] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.858061] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.858274] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.858417] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.858553] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 92cdcd51-3eaa-4c9b-817e-7acac6a70668 is going to be created. [ 1168.877633] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.877633] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.877633] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.877633] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.877909] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.878110] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-92cdcd51-3eaa-4c9b-817e-7acac6a70668" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.186377] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a8e68dbd-cf00-4b4f-9e45-bc68584b5a72 [ 1169.186377] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.186377] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.186377] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.186377] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.186377] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.186377] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a8e68dbd-cf00-4b4f-9e45-bc68584b5a72 already deleted. [ 1169.186377] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8e68dbd-cf00-4b4f-9e45-bc68584b5a72" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.599709] env[70764]: INFO networking_nsxv3.common.synchronization [req-7629cd4f-ce9c-4796-95e1-1b480e0f47ff req-5a3223c0-f8a8-499f-8f23-3ee2a4ac6125 service nova] Enqueued Resource ID: 12f4761e-3f37-4705-a034-61d725eca2f4 with Priority: HIGHEST for action security_group_rules [ 1169.600906] env[70764]: INFO networking_nsxv3.common.synchronization [req-7629cd4f-ce9c-4796-95e1-1b480e0f47ff req-5a3223c0-f8a8-499f-8f23-3ee2a4ac6125 service nova] Enqueued Resource ID: 12f4761e-3f37-4705-a034-61d725eca2f4 with Priority: HIGHEST for action security_group_members [ 1169.601179] env[70764]: INFO networking_nsxv3.common.synchronization [req-7629cd4f-ce9c-4796-95e1-1b480e0f47ff req-5a3223c0-f8a8-499f-8f23-3ee2a4ac6125 service nova] Enqueued Resource ID: 92cdcd51-3eaa-4c9b-817e-7acac6a70668 with Priority: HIGHEST for action port [ 1169.601991] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12f4761e-3f37-4705-a034-61d725eca2f4 with Priority: HIGHEST for action security_group_rules [ 1169.602266] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12f4761e-3f37-4705-a034-61d725eca2f4 with Priority: HIGHEST for action security_group_members [ 1169.602575] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92cdcd51-3eaa-4c9b-817e-7acac6a70668 with Priority: HIGHEST for action port [ 1169.602901] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12f4761e-3f37-4705-a034-61d725eca2f4 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.603109] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.603227] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.603814] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.603814] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12f4761e-3f37-4705-a034-61d725eca2f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.604772] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-12f4761e-3f37-4705-a034-61d725eca2f4 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.605029] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.605192] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.605462] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.605682] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.605902] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.606049] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.606731] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.606731] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.606731] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12f4761e-3f37-4705-a034-61d725eca2f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.607617] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-92cdcd51-3eaa-4c9b-817e-7acac6a70668 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.608313] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92cdcd51-3eaa-4c9b-817e-7acac6a70668" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.608313] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92cdcd51-3eaa-4c9b-817e-7acac6a70668" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.608313] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92cdcd51-3eaa-4c9b-817e-7acac6a70668" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.608313] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92cdcd51-3eaa-4c9b-817e-7acac6a70668',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.113183] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('12f4761e-3f37-4705-a034-61d725eca2f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.114356] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-12f4761e-3f37-4705-a034-61d725eca2f4 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.114580] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.115021] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 92cdcd51-3eaa-4c9b-817e-7acac6a70668 with status ACTIVE [ 1170.115204] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.115317] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.115383] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.115602] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.115692] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.115866] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.115965] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.116539] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.117726] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.117811] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.118023] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.118131] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.118259] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.118414] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.118492] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.118581] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 92cdcd51-3eaa-4c9b-817e-7acac6a70668 is going to be updated. [ 1170.137739] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.137945] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.137945] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.138168] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.138308] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.138467] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92cdcd51-3eaa-4c9b-817e-7acac6a70668" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.330804] env[70764]: INFO networking_nsxv3.common.synchronization [req-7629cd4f-ce9c-4796-95e1-1b480e0f47ff req-d0893fee-4ff1-4428-b924-27c775780dfa tempest-MultipleCreateTestJSON-132917574 tempest-MultipleCreateTestJSON-132917574-project-member] Enqueued Resource ID: 12f4761e-3f37-4705-a034-61d725eca2f4 with Priority: HIGHEST for action security_group_members [ 1170.335027] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12f4761e-3f37-4705-a034-61d725eca2f4 with Priority: HIGHEST for action security_group_members [ 1170.335027] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-12f4761e-3f37-4705-a034-61d725eca2f4 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.335027] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.597365] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-153 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.598373] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-153" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.598373] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-153" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.598373] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-153" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.598373] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.598693] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.598693] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.600071] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.600071] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.600071] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1170.600071] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1170.600071] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1170.600071] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1170.600071] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1170.600071] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1170.600071] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1170.615902] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('12f4761e-3f37-4705-a034-61d725eca2f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.617663] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1170.617902] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1170.618074] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1170.618251] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-153" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.618576] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-fff96ef1-1f50-47e9-a081-377daf190a42 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.618768] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-fff96ef1-1f50-47e9-a081-377daf190a42" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.619043] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-fff96ef1-1f50-47e9-a081-377daf190a42" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.619212] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-fff96ef1-1f50-47e9-a081-377daf190a42" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.619375] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fff96ef1-1f50-47e9-a081-377daf190a42',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.121508] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.121703] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.121757] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.121948] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.122052] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.122153] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12f4761e-3f37-4705-a034-61d725eca2f4 is going to be created. [ 1171.123763] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.124078] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.124143] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.124393] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.124717] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.124921] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port fff96ef1-1f50-47e9-a081-377daf190a42 not found, creating... [ 1171.125218] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.125389] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.125665] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.125927] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.126093] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.126397] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.126565] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.126686] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.126899] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.127055] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.127192] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: fff96ef1-1f50-47e9-a081-377daf190a42 is going to be created. [ 1171.146436] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.146648] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.146717] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.147011] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.147253] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.147474] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-fff96ef1-1f50-47e9-a081-377daf190a42" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.155747] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.155747] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.155747] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.155747] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.156086] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.166719] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12f4761e-3f37-4705-a034-61d725eca2f4 in Status: UNINITIALIZED for 2s [ 1171.935535] env[70764]: INFO networking_nsxv3.common.synchronization [req-7629cd4f-ce9c-4796-95e1-1b480e0f47ff req-b2398e36-d284-46cd-a855-869c9e1294e5 service nova] Enqueued Resource ID: 12f4761e-3f37-4705-a034-61d725eca2f4 with Priority: HIGHEST for action security_group_rules [ 1171.935852] env[70764]: INFO networking_nsxv3.common.synchronization [req-7629cd4f-ce9c-4796-95e1-1b480e0f47ff req-b2398e36-d284-46cd-a855-869c9e1294e5 service nova] Enqueued Resource ID: 12f4761e-3f37-4705-a034-61d725eca2f4 with Priority: HIGHEST for action security_group_members [ 1171.936113] env[70764]: INFO networking_nsxv3.common.synchronization [req-7629cd4f-ce9c-4796-95e1-1b480e0f47ff req-b2398e36-d284-46cd-a855-869c9e1294e5 service nova] Enqueued Resource ID: fff96ef1-1f50-47e9-a081-377daf190a42 with Priority: HIGHEST for action port [ 1171.936809] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12f4761e-3f37-4705-a034-61d725eca2f4 with Priority: HIGHEST for action security_group_rules [ 1171.937068] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12f4761e-3f37-4705-a034-61d725eca2f4 with Priority: HIGHEST for action security_group_members [ 1171.937175] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fff96ef1-1f50-47e9-a081-377daf190a42 with Priority: HIGHEST for action port [ 1171.937453] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12f4761e-3f37-4705-a034-61d725eca2f4 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.937556] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.937754] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-12f4761e-3f37-4705-a034-61d725eca2f4 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.937836] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.938016] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-fff96ef1-1f50-47e9-a081-377daf190a42 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.938120] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fff96ef1-1f50-47e9-a081-377daf190a42" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.938184] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fff96ef1-1f50-47e9-a081-377daf190a42" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.938380] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fff96ef1-1f50-47e9-a081-377daf190a42" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.938459] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fff96ef1-1f50-47e9-a081-377daf190a42',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.441858] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fff96ef1-1f50-47e9-a081-377daf190a42 with status ACTIVE [ 1172.442089] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.442236] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.442308] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.442670] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.442704] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.442889] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.442984] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.443249] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.443249] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.443354] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.443859] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.443859] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.443859] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.443859] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.443859] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.443859] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fff96ef1-1f50-47e9-a081-377daf190a42 is going to be updated. [ 1172.464316] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.464518] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.464611] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.464824] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.464962] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.465144] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fff96ef1-1f50-47e9-a081-377daf190a42" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.176654] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12f4761e-3f37-4705-a034-61d725eca2f4 in Status: SUCCESS [ 1173.176994] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.177061] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.177258] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.177439] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.177556] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.177623] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.177771] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.177850] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.177934] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.178049] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('12f4761e-3f37-4705-a034-61d725eca2f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.178848] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.179019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.179187] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.179288] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.179347] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.179489] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.179570] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.179714] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12f4761e-3f37-4705-a034-61d725eca2f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.683528] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-12f4761e-3f37-4705-a034-61d725eca2f4 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.683663] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.683892] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('12f4761e-3f37-4705-a034-61d725eca2f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.187763] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('12f4761e-3f37-4705-a034-61d725eca2f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.690875] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.691072] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.691148] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.691388] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.691483] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.691586] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12f4761e-3f37-4705-a034-61d725eca2f4 is going to be updated. [ 1174.721487] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.721652] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.721714] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.721906] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.722064] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.732246] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12f4761e-3f37-4705-a034-61d725eca2f4 in Status: IN_PROGRESS for 2s [ 1175.760411] env[70764]: INFO networking_nsxv3.common.synchronization [req-714b2fab-b253-4ad2-a8fd-3b43a0ab8c72 req-ea9cbc39-5a98-4fe9-8217-260fae5ded83 tempest-AttachInterfacesTestJSON-1880347664 tempest-AttachInterfacesTestJSON-1880347664-project-member] Enqueued Resource ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb with Priority: HIGHEST for action security_group_members [ 1175.761177] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb with Priority: HIGHEST for action security_group_members [ 1175.761330] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b7cd2f4-04ff-4e32-a598-282852b38ebb taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.761452] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.761519] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.762020] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.762020] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.762172] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.762172] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.762289] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.762372] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.762467] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b7cd2f4-04ff-4e32-a598-282852b38ebb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.064290] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-822 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.064500] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-822" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.064688] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-822" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.064961] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-822" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.065237] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.065397] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.065529] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.065759] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.065905] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.066126] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1176.066253] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1176.066350] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1176.066459] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1176.066571] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1176.066677] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1176.066809] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1176.087019] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1176.087019] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1176.087019] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1176.087019] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-822" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.087019] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-137a0796-b2e6-484c-bceb-f006c91438df taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.087312] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-137a0796-b2e6-484c-bceb-f006c91438df" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.087376] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-137a0796-b2e6-484c-bceb-f006c91438df" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.087681] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-137a0796-b2e6-484c-bceb-f006c91438df" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.087874] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('137a0796-b2e6-484c-bceb-f006c91438df',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.264505] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.264722] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.264797] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.265022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.265119] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.265324] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.265426] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.265488] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.265648] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.265716] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.265803] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb already deleted. [ 1176.265883] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.358432] env[70764]: INFO networking_nsxv3.common.synchronization [req-dbe723d8-35c7-4189-be61-539273ce6b6b req-b98f4cfb-6f39-454e-8ce6-dd955ef1ccd4 tempest-ServersTestMultiNic-1176763844 tempest-ServersTestMultiNic-1176763844-project-member] Enqueued Resource ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 with Priority: HIGHEST for action security_group_members [ 1176.359034] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 with Priority: HIGHEST for action security_group_members [ 1176.359296] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.359461] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.359505] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.359724] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.359881] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.359983] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.364120] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.364120] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.364120] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.364120] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d148e57-65c0-48a3-9e3c-7f9dc3d97849',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.593131] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.593131] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.593131] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.593131] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.593131] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.593131] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 137a0796-b2e6-484c-bceb-f006c91438df not found, creating... [ 1176.593131] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.593131] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.593131] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.593131] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.593131] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.593503] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.593503] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.593503] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.593912] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.594211] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.594495] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 137a0796-b2e6-484c-bceb-f006c91438df is going to be created. [ 1176.615750] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.615750] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.615750] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.615750] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.615750] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.615750] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-137a0796-b2e6-484c-bceb-f006c91438df" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.747971] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12f4761e-3f37-4705-a034-61d725eca2f4 in Status: SUCCESS [ 1176.748303] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.748531] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.748788] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.749032] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.749206] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.749845] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.749845] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.749845] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.749845] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12f4761e-3f37-4705-a034-61d725eca2f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.757418] env[70764]: INFO networking_nsxv3.common.synchronization [req-dbe723d8-35c7-4189-be61-539273ce6b6b req-72420b64-4717-46af-80e6-6451aa005bc9 tempest-ServersTestMultiNic-1176763844 tempest-ServersTestMultiNic-1176763844-project-member] Enqueued Resource ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 with Priority: HIGHEST for action security_group_members [ 1176.757672] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 with Priority: HIGHEST for action security_group_members [ 1176.758630] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.758801] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.867449] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.867449] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.867864] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.867864] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.867992] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.868174] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.868330] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.868388] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.868656] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.868656] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.868759] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 already deleted. [ 1176.868797] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.868999] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.869185] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.869331] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.869427] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.869488] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.869625] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.869703] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.869813] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d148e57-65c0-48a3-9e3c-7f9dc3d97849',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.029056] env[70764]: INFO networking_nsxv3.common.synchronization [req-dbe723d8-35c7-4189-be61-539273ce6b6b req-424235ff-451b-451e-8e43-ba5020cb28f4 tempest-ServersTestMultiNic-1176763844 tempest-ServersTestMultiNic-1176763844-project-member] Enqueued Resource ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 with Priority: HIGHEST for action security_group_members [ 1177.029559] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 with Priority: HIGHEST for action security_group_members [ 1177.029879] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.029985] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.252168] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('12f4761e-3f37-4705-a034-61d725eca2f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.373269] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.373442] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.373522] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.373783] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.373882] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.374110] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.374208] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.374269] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.374413] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.374854] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.374854] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 already deleted. [ 1177.374854] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.374854] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.375020] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.375099] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.375196] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.375248] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.375389] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.375462] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.375554] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d148e57-65c0-48a3-9e3c-7f9dc3d97849',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.405842] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-327 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.406130] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-327" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.406271] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-327" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.406660] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-327" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.406991] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.407209] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.407359] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.407607] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.407763] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.407970] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1177.408099] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1177.408217] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1177.408327] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1177.408450] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1177.408564] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1177.408700] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1177.427598] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1177.427785] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1177.427900] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1177.428100] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-327" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.428424] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-ed47a97c-fdcd-463b-b37e-664e4f152106 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.428593] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-ed47a97c-fdcd-463b-b37e-664e4f152106" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.428714] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-ed47a97c-fdcd-463b-b37e-664e4f152106" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.429044] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-ed47a97c-fdcd-463b-b37e-664e4f152106" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.429193] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed47a97c-fdcd-463b-b37e-664e4f152106',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.439128] env[70764]: INFO networking_nsxv3.common.synchronization [req-714b2fab-b253-4ad2-a8fd-3b43a0ab8c72 req-974221d7-4680-494d-a22d-21319a772615 service nova] Enqueued Resource ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb with Priority: HIGHEST for action security_group_rules [ 1177.439634] env[70764]: INFO networking_nsxv3.common.synchronization [req-714b2fab-b253-4ad2-a8fd-3b43a0ab8c72 req-974221d7-4680-494d-a22d-21319a772615 service nova] Enqueued Resource ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb with Priority: HIGHEST for action security_group_members [ 1177.439835] env[70764]: INFO networking_nsxv3.common.synchronization [req-714b2fab-b253-4ad2-a8fd-3b43a0ab8c72 req-974221d7-4680-494d-a22d-21319a772615 service nova] Enqueued Resource ID: 137a0796-b2e6-484c-bceb-f006c91438df with Priority: HIGHEST for action port [ 1177.440057] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb with Priority: HIGHEST for action security_group_rules [ 1177.440349] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb with Priority: HIGHEST for action security_group_members [ 1177.440464] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 137a0796-b2e6-484c-bceb-f006c91438df with Priority: HIGHEST for action port [ 1177.441169] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b7cd2f4-04ff-4e32-a598-282852b38ebb taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.441373] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.441505] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.441795] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.441936] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b7cd2f4-04ff-4e32-a598-282852b38ebb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.442981] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b7cd2f4-04ff-4e32-a598-282852b38ebb taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.443123] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.443270] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.443478] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.444043] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.444226] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.444331] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.444579] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.444702] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.444859] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b7cd2f4-04ff-4e32-a598-282852b38ebb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.445915] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-137a0796-b2e6-484c-bceb-f006c91438df taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.446053] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-137a0796-b2e6-484c-bceb-f006c91438df" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.446164] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-137a0796-b2e6-484c-bceb-f006c91438df" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.446410] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-137a0796-b2e6-484c-bceb-f006c91438df" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.446589] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('137a0796-b2e6-484c-bceb-f006c91438df',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.754087] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('12f4761e-3f37-4705-a034-61d725eca2f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.877695] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.878034] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.878034] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.878503] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.878503] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.878696] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.878911] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.878911] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.879057] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.879141] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.879226] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 already deleted. [ 1177.879314] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.931675] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.931900] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.932062] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.932450] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.932625] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.932823] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port ed47a97c-fdcd-463b-b37e-664e4f152106 not found, creating... [ 1177.933169] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.933343] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.933467] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.933693] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.933865] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.934227] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.934395] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.934517] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.934764] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.934904] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.935059] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: ed47a97c-fdcd-463b-b37e-664e4f152106 is going to be created. [ 1177.948086] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9b7cd2f4-04ff-4e32-a598-282852b38ebb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.949074] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b7cd2f4-04ff-4e32-a598-282852b38ebb taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.949216] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.949559] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 137a0796-b2e6-484c-bceb-f006c91438df with status ACTIVE [ 1177.949681] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.949779] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.949840] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.950039] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.950111] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.950272] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.950368] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.950441] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.950572] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.950648] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.950825] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.950918] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.950982] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.951132] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.951208] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.951294] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 137a0796-b2e6-484c-bceb-f006c91438df is going to be updated. [ 1177.963338] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.963601] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.963670] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.963906] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.964148] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.964372] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-ed47a97c-fdcd-463b-b37e-664e4f152106" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.971414] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.971575] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.971615] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.971762] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.971880] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.972042] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-137a0796-b2e6-484c-bceb-f006c91438df" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.256521] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.256785] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.256785] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.256966] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.257078] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.257174] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12f4761e-3f37-4705-a034-61d725eca2f4 is going to be updated. [ 1178.286069] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.286276] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.286276] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.286493] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.286620] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.303367] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12f4761e-3f37-4705-a034-61d725eca2f4 in Status: IN_PROGRESS for 2s [ 1178.451128] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9b7cd2f4-04ff-4e32-a598-282852b38ebb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.810981] env[70764]: INFO networking_nsxv3.common.synchronization [req-dbe723d8-35c7-4189-be61-539273ce6b6b req-50213a28-5bd9-4117-9048-33ac05374ce9 service nova] Enqueued Resource ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 with Priority: HIGHEST for action security_group_rules [ 1178.811187] env[70764]: INFO networking_nsxv3.common.synchronization [req-dbe723d8-35c7-4189-be61-539273ce6b6b req-50213a28-5bd9-4117-9048-33ac05374ce9 service nova] Enqueued Resource ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 with Priority: HIGHEST for action security_group_members [ 1178.811329] env[70764]: INFO networking_nsxv3.common.synchronization [req-dbe723d8-35c7-4189-be61-539273ce6b6b req-50213a28-5bd9-4117-9048-33ac05374ce9 service nova] Enqueued Resource ID: ed47a97c-fdcd-463b-b37e-664e4f152106 with Priority: HIGHEST for action port [ 1178.811866] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 with Priority: HIGHEST for action security_group_rules [ 1178.811995] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 with Priority: HIGHEST for action security_group_members [ 1178.812106] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed47a97c-fdcd-463b-b37e-664e4f152106 with Priority: HIGHEST for action port [ 1178.812378] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d148e57-65c0-48a3-9e3c-7f9dc3d97849 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.812503] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.812564] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.812826] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.812904] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d148e57-65c0-48a3-9e3c-7f9dc3d97849',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.813715] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.813831] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.813906] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.814128] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.814303] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.814403] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.814465] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.814653] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.814729] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.814823] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d148e57-65c0-48a3-9e3c-7f9dc3d97849',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.815531] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed47a97c-fdcd-463b-b37e-664e4f152106 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.815876] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed47a97c-fdcd-463b-b37e-664e4f152106" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.815876] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed47a97c-fdcd-463b-b37e-664e4f152106" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.815876] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed47a97c-fdcd-463b-b37e-664e4f152106" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.815999] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed47a97c-fdcd-463b-b37e-664e4f152106',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.955133] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.955523] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.955523] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.955618] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.955654] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.955746] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb is going to be created. [ 1178.976856] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.977091] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.977091] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.977293] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.977443] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.986202] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb in Status: UNINITIALIZED for 2s [ 1179.318037] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.318202] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.318295] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d148e57-65c0-48a3-9e3c-7f9dc3d97849',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.319222] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ed47a97c-fdcd-463b-b37e-664e4f152106 with status ACTIVE [ 1179.319405] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.319516] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.319585] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.319787] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.319870] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.320050] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.320148] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.320210] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.320361] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.320439] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.320628] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.320723] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.320782] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.320918] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.320992] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.321088] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ed47a97c-fdcd-463b-b37e-664e4f152106 is going to be updated. [ 1179.339945] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.340088] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.340160] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.340352] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.340478] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.340634] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed47a97c-fdcd-463b-b37e-664e4f152106" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.551839] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-172 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.552100] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-172" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.552192] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-172" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.552586] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-172" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.552860] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.553037] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.553165] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.553394] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.553543] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.553757] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1179.553877] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1179.553990] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1179.554116] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1179.554230] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1179.554342] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1179.554481] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1179.572947] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1179.573174] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1179.573351] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1179.573569] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-172" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.573935] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-e6714408-1adf-4fe7-87f8-d608c483811c taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.574152] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-e6714408-1adf-4fe7-87f8-d608c483811c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.574310] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-e6714408-1adf-4fe7-87f8-d608c483811c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.574701] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-e6714408-1adf-4fe7-87f8-d608c483811c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.574873] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6714408-1adf-4fe7-87f8-d608c483811c',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.824130] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d148e57-65c0-48a3-9e3c-7f9dc3d97849',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.077499] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.077882] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.077882] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.078078] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.078235] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.078392] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port e6714408-1adf-4fe7-87f8-d608c483811c not found, creating... [ 1180.078661] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.078822] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.078941] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.079168] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.079317] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.079577] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.079739] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.079855] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.080072] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.080203] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.080343] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: e6714408-1adf-4fe7-87f8-d608c483811c is going to be created. [ 1180.097937] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.098142] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.098244] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.098459] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.098674] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.098885] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-e6714408-1adf-4fe7-87f8-d608c483811c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.315284] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12f4761e-3f37-4705-a034-61d725eca2f4 in Status: SUCCESS [ 1180.315508] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.315706] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.315924] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.316132] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.316248] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.316312] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.316463] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.316542] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.316627] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.316781] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-12f4761e-3f37-4705-a034-61d725eca2f4 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.316902] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.316966] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.317125] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.317266] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.317358] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.317419] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.317554] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.317629] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.317710] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.317797] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('12f4761e-3f37-4705-a034-61d725eca2f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.325336] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.325455] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.325497] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.325697] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.325787] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.325880] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 is going to be created. [ 1180.346246] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.346368] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.346420] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.346585] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.346731] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.354679] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 in Status: UNINITIALIZED for 2s [ 1180.765335] env[70764]: INFO networking_nsxv3.common.synchronization [req-dbe723d8-35c7-4189-be61-539273ce6b6b req-24d2abe3-a5c8-4c29-8baa-c9c059e8ca05 service nova] Enqueued Resource ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 with Priority: HIGHEST for action security_group_rules [ 1180.765542] env[70764]: INFO networking_nsxv3.common.synchronization [req-dbe723d8-35c7-4189-be61-539273ce6b6b req-24d2abe3-a5c8-4c29-8baa-c9c059e8ca05 service nova] Enqueued Resource ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 with Priority: HIGHEST for action security_group_members [ 1180.765637] env[70764]: INFO networking_nsxv3.common.synchronization [req-dbe723d8-35c7-4189-be61-539273ce6b6b req-24d2abe3-a5c8-4c29-8baa-c9c059e8ca05 service nova] Enqueued Resource ID: e6714408-1adf-4fe7-87f8-d608c483811c with Priority: HIGHEST for action port [ 1180.765876] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 with Priority: HIGHEST for action security_group_rules [ 1180.766011] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 with Priority: HIGHEST for action security_group_members [ 1180.766115] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6714408-1adf-4fe7-87f8-d608c483811c with Priority: HIGHEST for action port [ 1180.766715] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d148e57-65c0-48a3-9e3c-7f9dc3d97849 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.766791] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.766998] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.767110] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.767251] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-e6714408-1adf-4fe7-87f8-d608c483811c taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.767355] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e6714408-1adf-4fe7-87f8-d608c483811c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.767410] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e6714408-1adf-4fe7-87f8-d608c483811c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.767614] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e6714408-1adf-4fe7-87f8-d608c483811c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.767712] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6714408-1adf-4fe7-87f8-d608c483811c',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.821077] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 12f4761e-3f37-4705-a034-61d725eca2f4: rpc.has_security_group_logging(os_id): False [ 1180.836923] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.837121] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.837121] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.837314] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.837413] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.837636] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.837742] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.837811] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.837958] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.838046] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.838223] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.838317] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.838379] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.838544] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.838544] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.838801] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.838894] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.838955] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.839103] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.839178] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.839264] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12f4761e-3f37-4705-a034-61d725eca2f4 is going to be created. [ 1180.893893] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.894154] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.894255] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.894523] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.894870] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.904744] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12f4761e-3f37-4705-a034-61d725eca2f4 in Status: IN_PROGRESS for 2s [ 1180.996641] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb in Status: SUCCESS [ 1180.996867] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.997100] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.997384] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.997574] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.997688] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.997756] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.997894] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.997972] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.998074] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.998165] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9b7cd2f4-04ff-4e32-a598-282852b38ebb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.270925] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e6714408-1adf-4fe7-87f8-d608c483811c with status ACTIVE [ 1181.271298] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.271430] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.271430] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.271640] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.271787] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.271990] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.272637] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.272637] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.272637] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.272637] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.272637] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.272637] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.273046] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.273046] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.273046] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.273046] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e6714408-1adf-4fe7-87f8-d608c483811c is going to be updated. [ 1181.296701] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.296958] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.296958] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.297204] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.297381] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.297677] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e6714408-1adf-4fe7-87f8-d608c483811c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.500737] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b7cd2f4-04ff-4e32-a598-282852b38ebb taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.500737] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.500835] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.501038] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.501242] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.501352] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.501411] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.501598] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.501694] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.501784] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.501996] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b7cd2f4-04ff-4e32-a598-282852b38ebb taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.502076] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.502107] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.502251] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.502411] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.502524] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.502590] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.502691] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.502779] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.502871] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.502973] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9b7cd2f4-04ff-4e32-a598-282852b38ebb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.507948] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-327 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.508074] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-327" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.508128] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-327" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.508331] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-327" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.508589] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.508750] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.508867] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.509336] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.509336] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.509479] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1181.509592] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1181.509860] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1181.509860] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1181.509972] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1181.510131] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1181.510180] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1181.529189] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1181.529491] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1181.529728] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1181.530015] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-327" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.530454] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-8751334c-3980-4487-b93d-67b504a3c208 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.530768] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-8751334c-3980-4487-b93d-67b504a3c208" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.531013] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-8751334c-3980-4487-b93d-67b504a3c208" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.531575] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-8751334c-3980-4487-b93d-67b504a3c208" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.531902] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8751334c-3980-4487-b93d-67b504a3c208',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.011936] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9b7cd2f4-04ff-4e32-a598-282852b38ebb: rpc.has_security_group_logging(os_id): False [ 1182.028508] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.028664] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.028723] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.028928] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.029030] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.029224] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.029326] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.029387] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.029538] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.029618] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.029798] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.029894] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.029954] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.030106] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.030180] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.030373] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.030466] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.030528] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.030665] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.030739] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.030823] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb is going to be created. [ 1182.035806] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.035956] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.036082] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.036384] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.036595] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.036816] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 8751334c-3980-4487-b93d-67b504a3c208 not found, creating... [ 1182.037243] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.037463] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.037662] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.037941] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.038185] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.038544] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.038784] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.038982] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.039267] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.039473] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.039691] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 8751334c-3980-4487-b93d-67b504a3c208 is going to be created. [ 1182.056015] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.056135] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.056213] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.056411] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.056628] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.056845] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-8751334c-3980-4487-b93d-67b504a3c208" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.085901] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.086128] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.086248] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.086538] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.086781] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.095933] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb in Status: IN_PROGRESS for 2s [ 1182.364694] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 in Status: SUCCESS [ 1182.364694] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.364694] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.365197] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.365197] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.365197] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.365347] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.365386] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.365468] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.365531] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.365986] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d148e57-65c0-48a3-9e3c-7f9dc3d97849',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.366488] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.366676] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.366821] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.366931] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.366997] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.367150] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.367229] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.367316] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d148e57-65c0-48a3-9e3c-7f9dc3d97849',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.857580] env[70764]: INFO networking_nsxv3.common.synchronization [req-dbe723d8-35c7-4189-be61-539273ce6b6b req-63cfa50d-026d-48b1-98fb-1a77858b78ea service nova] Enqueued Resource ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 with Priority: HIGHEST for action security_group_rules [ 1182.857751] env[70764]: INFO networking_nsxv3.common.synchronization [req-dbe723d8-35c7-4189-be61-539273ce6b6b req-63cfa50d-026d-48b1-98fb-1a77858b78ea service nova] Enqueued Resource ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 with Priority: HIGHEST for action security_group_members [ 1182.857890] env[70764]: INFO networking_nsxv3.common.synchronization [req-dbe723d8-35c7-4189-be61-539273ce6b6b req-63cfa50d-026d-48b1-98fb-1a77858b78ea service nova] Enqueued Resource ID: 8751334c-3980-4487-b93d-67b504a3c208 with Priority: HIGHEST for action port [ 1182.858647] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 with Priority: HIGHEST for action security_group_rules [ 1182.858647] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 with Priority: HIGHEST for action security_group_members [ 1182.858647] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8751334c-3980-4487-b93d-67b504a3c208 with Priority: HIGHEST for action port [ 1182.858922] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d148e57-65c0-48a3-9e3c-7f9dc3d97849 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.859197] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.859454] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.859571] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.859793] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-8751334c-3980-4487-b93d-67b504a3c208 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.859921] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8751334c-3980-4487-b93d-67b504a3c208" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.860010] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8751334c-3980-4487-b93d-67b504a3c208" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.860232] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8751334c-3980-4487-b93d-67b504a3c208" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.860344] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8751334c-3980-4487-b93d-67b504a3c208',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.869351] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.869351] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.873194] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d148e57-65c0-48a3-9e3c-7f9dc3d97849',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.916783] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12f4761e-3f37-4705-a034-61d725eca2f4 in Status: SUCCESS [ 1182.917193] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.917457] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.917837] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.918189] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12f4761e-3f37-4705-a034-61d725eca2f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.362278] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8751334c-3980-4487-b93d-67b504a3c208 with status ACTIVE [ 1183.362531] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.362824] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.362927] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.363268] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.363419] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.363738] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.363912] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.364040] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.364286] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.364423] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.364809] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.365060] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.365060] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.365199] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.365277] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.365369] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8751334c-3980-4487-b93d-67b504a3c208 is going to be updated. [ 1183.375658] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d148e57-65c0-48a3-9e3c-7f9dc3d97849',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.385818] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.385818] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.385818] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.386154] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.386154] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.386301] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8751334c-3980-4487-b93d-67b504a3c208" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.420230] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-12f4761e-3f37-4705-a034-61d725eca2f4 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.420373] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.420433] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.420648] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.420841] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.420933] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.420967] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.421124] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.421255] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.423858] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.423858] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('12f4761e-3f37-4705-a034-61d725eca2f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.878446] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.878637] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.878716] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.878926] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.879032] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.879711] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 is going to be updated. [ 1183.905206] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.905356] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.905428] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.905657] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.905803] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.913927] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 in Status: IN_PROGRESS for 2s [ 1183.925535] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-12f4761e-3f37-4705-a034-61d725eca2f4 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.925699] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.926045] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.926045] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.926200] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.926302] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.926369] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.926529] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.926619] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.926708] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.926856] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-12f4761e-3f37-4705-a034-61d725eca2f4 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.926951] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.927013] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.927187] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.927300] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.927391] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.927451] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.927588] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.927708] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.927744] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.927829] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('12f4761e-3f37-4705-a034-61d725eca2f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.113913] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb in Status: SUCCESS [ 1184.114241] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.429990] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 12f4761e-3f37-4705-a034-61d725eca2f4: rpc.has_security_group_logging(os_id): False [ 1184.449411] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.449557] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.449659] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.449834] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.449930] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.450179] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.450284] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.450349] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.450500] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.450579] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.450757] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.450851] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.450912] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.451061] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.451137] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.451720] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.451859] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.451925] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.452086] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.452164] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.452279] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12f4761e-3f37-4705-a034-61d725eca2f4 is going to be updated. [ 1184.511264] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.511445] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.513786] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.513786] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.513786] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.528066] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12f4761e-3f37-4705-a034-61d725eca2f4 in Status: IN_PROGRESS for 2s [ 1184.775547] env[70764]: INFO networking_nsxv3.common.synchronization [req-1e6caf68-265b-4f03-974a-998303c7412b req-9e843b0a-181b-4c25-9179-d6cc81a6b6e1 tempest-DeleteServersTestJSON-1788501793 tempest-DeleteServersTestJSON-1788501793-project-member] Enqueued Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGHEST for action security_group_members [ 1184.776080] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGHEST for action security_group_members [ 1184.776388] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-3379805b-13ae-4057-9511-570e8b3c2437 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.776513] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.776603] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.776810] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.776985] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.777507] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.777580] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.777768] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.777824] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.777943] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3379805b-13ae-4057-9511-570e8b3c2437',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.280602] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.280764] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.280840] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.281086] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.281308] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.281550] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.281780] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.281941] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.282159] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.282277] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.282392] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3379805b-13ae-4057-9511-570e8b3c2437 is going to be updated. [ 1185.306521] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.306637] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.306718] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.306900] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.307084] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.315117] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3379805b-13ae-4057-9511-570e8b3c2437 in Status: IN_PROGRESS for 2s [ 1185.516342] env[70764]: INFO networking_nsxv3.common.synchronization [req-7a3c9863-fa6c-4862-a7c4-53d4da04acb9 req-523fed19-3034-4c7f-aff4-750e49dd909c tempest-MultipleCreateTestJSON-132917574 tempest-MultipleCreateTestJSON-132917574-project-member] Enqueued Resource ID: 12f4761e-3f37-4705-a034-61d725eca2f4 with Priority: HIGHEST for action security_group_members [ 1185.516883] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12f4761e-3f37-4705-a034-61d725eca2f4 with Priority: HIGHEST for action security_group_members [ 1185.517211] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-12f4761e-3f37-4705-a034-61d725eca2f4 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.517337] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.517402] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.517599] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.517750] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.517853] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.517918] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.518274] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.518379] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.518493] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12f4761e-3f37-4705-a034-61d725eca2f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.570076] env[70764]: INFO networking_nsxv3.common.synchronization [req-339d7774-488f-411e-9dab-deae42867851 req-83283d0b-06b9-4431-b995-9c33358d8fd6 tempest-MultipleCreateTestJSON-132917574 tempest-MultipleCreateTestJSON-132917574-project-member] Enqueued Resource ID: 12f4761e-3f37-4705-a034-61d725eca2f4 with Priority: HIGHEST for action security_group_members [ 1185.570239] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12f4761e-3f37-4705-a034-61d725eca2f4 with Priority: HIGHEST for action security_group_members [ 1185.570478] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-12f4761e-3f37-4705-a034-61d725eca2f4 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.570635] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.924055] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 in Status: SUCCESS [ 1185.924055] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.924055] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.924055] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.924055] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.924055] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.924055] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.924055] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.924400] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.924400] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d148e57-65c0-48a3-9e3c-7f9dc3d97849',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.021613] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.021781] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.021842] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.022091] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.022190] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.022392] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.022495] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.022594] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.022751] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.022828] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.022918] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12f4761e-3f37-4705-a034-61d725eca2f4 is going to be updated. [ 1186.046057] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.046202] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.046279] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.046431] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.046560] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.053934] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12f4761e-3f37-4705-a034-61d725eca2f4 in Status: IN_PROGRESS for 2s [ 1186.425921] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d148e57-65c0-48a3-9e3c-7f9dc3d97849',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.539711] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12f4761e-3f37-4705-a034-61d725eca2f4 in Status: SUCCESS [ 1186.540096] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.928642] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d148e57-65c0-48a3-9e3c-7f9dc3d97849',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.232021] env[70764]: INFO networking_nsxv3.common.synchronization [req-36bcf449-76e9-4a94-aa04-fa780d36d6c3 req-df5e6236-5493-4742-9d73-fac1410d7277 tempest-ListImageFiltersTestJSON-1188056954 tempest-ListImageFiltersTestJSON-1188056954-project-member] Enqueued Resource ID: 90e38802-c5d5-43ce-9d13-c67ca1804885 with Priority: HIGHEST for action security_group_members [ 1187.232021] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90e38802-c5d5-43ce-9d13-c67ca1804885 with Priority: HIGHEST for action security_group_members [ 1187.232021] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-90e38802-c5d5-43ce-9d13-c67ca1804885 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.232021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.232021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.232021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.232021] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.232021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.232021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.232021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.232021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.232021] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90e38802-c5d5-43ce-9d13-c67ca1804885',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.324567] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3379805b-13ae-4057-9511-570e8b3c2437 in Status: SUCCESS [ 1187.324828] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3379805b-13ae-4057-9511-570e8b3c2437 deletion is rescheduled due to dependency. [ 1187.324934] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.431426] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.431624] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.431624] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.431841] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.431929] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.432044] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 is going to be updated. [ 1187.458199] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.458403] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.458403] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.458628] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.458776] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.467356] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 in Status: IN_PROGRESS for 2s [ 1187.735348] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('90e38802-c5d5-43ce-9d13-c67ca1804885',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.072582] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12f4761e-3f37-4705-a034-61d725eca2f4 in Status: SUCCESS [ 1188.072852] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12f4761e-3f37-4705-a034-61d725eca2f4 deletion is rescheduled due to dependency. [ 1188.072981] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.073169] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.073383] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.073574] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.073700] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.073755] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.073918] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.073998] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.074200] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12f4761e-3f37-4705-a034-61d725eca2f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.238372] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('90e38802-c5d5-43ce-9d13-c67ca1804885',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.581015] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.581015] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.581015] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.581015] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.581015] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.581015] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.581015] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.581015] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.581015] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.581015] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.581015] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12f4761e-3f37-4705-a034-61d725eca2f4 is going to be updated. [ 1188.604123] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.604123] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.604123] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.604123] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.604123] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.611727] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12f4761e-3f37-4705-a034-61d725eca2f4 in Status: IN_PROGRESS for 2s [ 1188.707166] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-428 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.707375] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-428" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.707780] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-428" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.707780] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-428" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.708047] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.708213] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.708333] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.708537] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.708706] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.709112] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1188.709112] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1188.709112] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1188.709238] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1188.709320] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1188.709428] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1188.709561] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1188.728184] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1188.728447] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1188.728543] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1188.728672] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-428" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.729124] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-a7846129-d037-4b74-aaa6-f7dd287d878d taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.729217] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-a7846129-d037-4b74-aaa6-f7dd287d878d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.729335] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-a7846129-d037-4b74-aaa6-f7dd287d878d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.729598] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-a7846129-d037-4b74-aaa6-f7dd287d878d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.729735] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7846129-d037-4b74-aaa6-f7dd287d878d',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.739476] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.739850] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.739850] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.739921] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.740054] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.740142] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90e38802-c5d5-43ce-9d13-c67ca1804885 is going to be updated. [ 1188.770960] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.770960] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.770960] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.770960] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.770960] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.779161] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90e38802-c5d5-43ce-9d13-c67ca1804885 in Status: IN_PROGRESS for 2s [ 1189.232433] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.232700] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.232838] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.233143] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.233296] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.233592] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.233754] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.233874] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.234114] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.234254] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.234535] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.234732] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.234835] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.235058] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.235195] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.235336] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: a7846129-d037-4b74-aaa6-f7dd287d878d is going to be updated. [ 1189.258938] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.259167] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.259292] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.259562] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.259959] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.259959] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-a7846129-d037-4b74-aaa6-f7dd287d878d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.477118] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 in Status: SUCCESS [ 1189.477347] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.477525] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.477749] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.477954] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.478084] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.478149] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.478317] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.478408] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.478494] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.478657] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.478753] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.478814] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.478950] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.479097] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.479189] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.479248] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.479380] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.479451] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.479529] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.479616] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d148e57-65c0-48a3-9e3c-7f9dc3d97849',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.981830] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d148e57-65c0-48a3-9e3c-7f9dc3d97849: rpc.has_security_group_logging(os_id): False [ 1190.007708] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.007858] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.007973] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.008164] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.008253] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.008447] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.008546] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.008608] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.008755] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.008833] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.009032] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.009128] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.009189] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.009326] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.009397] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.009578] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.009669] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.009727] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.009864] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.009936] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.010934] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 is going to be created. [ 1190.049608] env[70764]: INFO networking_nsxv3.common.synchronization [req-3a0e71c4-9ae2-4241-afe8-870f31e78e69 req-60d16451-d947-40a6-83c6-c5dca910e9d0 service nova] Enqueued Resource ID: 01588700-3c33-4723-87f1-c5abc176445e with Priority: HIGHEST for action security_group_rules [ 1190.049796] env[70764]: INFO networking_nsxv3.common.synchronization [req-3a0e71c4-9ae2-4241-afe8-870f31e78e69 req-60d16451-d947-40a6-83c6-c5dca910e9d0 service nova] Enqueued Resource ID: 01588700-3c33-4723-87f1-c5abc176445e with Priority: HIGHEST for action security_group_members [ 1190.049942] env[70764]: INFO networking_nsxv3.common.synchronization [req-3a0e71c4-9ae2-4241-afe8-870f31e78e69 req-60d16451-d947-40a6-83c6-c5dca910e9d0 service nova] Enqueued Resource ID: a7846129-d037-4b74-aaa6-f7dd287d878d with Priority: HIGHEST for action port [ 1190.050181] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01588700-3c33-4723-87f1-c5abc176445e with Priority: HIGHEST for action security_group_rules [ 1190.050308] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01588700-3c33-4723-87f1-c5abc176445e with Priority: HIGHEST for action security_group_members [ 1190.050402] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7846129-d037-4b74-aaa6-f7dd287d878d with Priority: HIGHEST for action port [ 1190.050952] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01588700-3c33-4723-87f1-c5abc176445e taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.051162] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.051162] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.051346] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.051430] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01588700-3c33-4723-87f1-c5abc176445e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.052223] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-01588700-3c33-4723-87f1-c5abc176445e taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.052643] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.052736] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.052898] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.053148] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.053268] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.053333] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.053479] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.053565] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.053654] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01588700-3c33-4723-87f1-c5abc176445e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.054664] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7846129-d037-4b74-aaa6-f7dd287d878d taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.054799] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7846129-d037-4b74-aaa6-f7dd287d878d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.054869] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7846129-d037-4b74-aaa6-f7dd287d878d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.055409] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7846129-d037-4b74-aaa6-f7dd287d878d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.055519] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7846129-d037-4b74-aaa6-f7dd287d878d',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.079393] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.079536] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.079608] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.079818] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.080028] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.093203] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 in Status: IN_PROGRESS for 2s [ 1190.558158] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-01588700-3c33-4723-87f1-c5abc176445e taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.558306] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.558518] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01588700-3c33-4723-87f1-c5abc176445e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.559475] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a7846129-d037-4b74-aaa6-f7dd287d878d with status ACTIVE [ 1190.559669] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.559801] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.559861] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.560110] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.560206] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.560397] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.560496] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.560558] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.560737] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.560816] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.561095] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.561173] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.561211] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.561346] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.561429] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.561523] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a7846129-d037-4b74-aaa6-f7dd287d878d is going to be updated. [ 1190.602989] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.603175] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.603253] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.603519] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.603663] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.603828] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7846129-d037-4b74-aaa6-f7dd287d878d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.623939] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12f4761e-3f37-4705-a034-61d725eca2f4 in Status: SUCCESS [ 1190.624154] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12f4761e-3f37-4705-a034-61d725eca2f4 deletion is rescheduled due to dependency. [ 1190.624281] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.797472] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90e38802-c5d5-43ce-9d13-c67ca1804885 in Status: SUCCESS [ 1190.797645] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.860103] env[70764]: INFO networking_nsxv3.common.synchronization [req-ce5f52c1-18cb-4216-85a7-ed6800373ded req-eda47f4a-1fbb-4aa8-bfdb-3af236b3300b tempest-AttachInterfacesTestJSON-1880347664 tempest-AttachInterfacesTestJSON-1880347664-project-member] Enqueued Resource ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb with Priority: HIGHEST for action security_group_members [ 1190.860553] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb with Priority: HIGHEST for action security_group_members [ 1190.860869] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b7cd2f4-04ff-4e32-a598-282852b38ebb taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.861080] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.861149] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.861341] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.861497] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.861595] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.861657] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.862761] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.862872] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.863009] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b7cd2f4-04ff-4e32-a598-282852b38ebb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.063897] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01588700-3c33-4723-87f1-c5abc176445e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.367099] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.367099] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.367099] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.367099] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.367099] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.367382] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.367382] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.367382] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.367506] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.367540] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.367614] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb is going to be updated. [ 1191.393469] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.393605] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.393683] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.393856] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.393993] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.401515] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb in Status: IN_PROGRESS for 2s [ 1191.565738] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.565954] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.566047] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.566314] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.566398] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.566466] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01588700-3c33-4723-87f1-c5abc176445e is going to be updated. [ 1191.593655] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.593655] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.593655] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.593655] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.593655] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.601315] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01588700-3c33-4723-87f1-c5abc176445e in Status: IN_PROGRESS for 2s [ 1192.104150] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 in Status: SUCCESS [ 1192.104486] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.104597] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.104831] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.105116] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d148e57-65c0-48a3-9e3c-7f9dc3d97849',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.609766] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.609766] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.609766] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.609766] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.609766] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.609766] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.609766] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.609766] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.609766] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.609766] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.609766] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d148e57-65c0-48a3-9e3c-7f9dc3d97849',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.112859] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.113283] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.113283] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.113283] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.113442] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.113545] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.113608] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.113756] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.113848] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.113937] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.114101] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.114195] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.114255] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.114479] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.114551] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.114620] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.114679] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.114862] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.114937] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.115028] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.115120] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d148e57-65c0-48a3-9e3c-7f9dc3d97849',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.411946] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb in Status: SUCCESS [ 1193.412154] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb deletion is rescheduled due to dependency. [ 1193.412269] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.610230] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01588700-3c33-4723-87f1-c5abc176445e in Status: SUCCESS [ 1193.610375] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.610749] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.610749] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.610917] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.611030] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.611114] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.611301] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.611389] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.611495] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.611598] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('01588700-3c33-4723-87f1-c5abc176445e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.617230] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d148e57-65c0-48a3-9e3c-7f9dc3d97849: rpc.has_security_group_logging(os_id): False [ 1193.634466] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.634624] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.634696] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.634944] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.635065] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.635287] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.635396] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.635459] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.635624] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.635704] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.635914] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.636018] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.636084] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.636224] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.636297] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.636489] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.636607] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.636636] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.636770] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.636846] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.636925] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 is going to be updated. [ 1193.695896] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.696167] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.696233] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.697527] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.697527] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.708774] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 in Status: IN_PROGRESS for 2s [ 1193.729953] env[70764]: INFO networking_nsxv3.common.synchronization [req-e3f75376-c9f4-4ddb-b2d4-2a679d0f98fc req-511ec5aa-fd90-41ea-941d-ab0c9750c787 tempest-ServersTestMultiNic-1176763844 tempest-ServersTestMultiNic-1176763844-project-member] Enqueued Resource ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 with Priority: HIGHEST for action security_group_members [ 1193.730392] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 with Priority: HIGHEST for action security_group_members [ 1193.733144] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.733414] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.733414] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.733617] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.733827] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.733958] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.734037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.734270] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.734418] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.734550] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d148e57-65c0-48a3-9e3c-7f9dc3d97849',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.114862] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-01588700-3c33-4723-87f1-c5abc176445e taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.114862] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.114862] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.114862] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.114862] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.114862] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.115362] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.115362] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.115362] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.115362] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.115544] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-01588700-3c33-4723-87f1-c5abc176445e taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.115544] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.115621] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.115841] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.115913] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.116018] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.116077] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.116234] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.116309] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.116404] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.116494] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('01588700-3c33-4723-87f1-c5abc176445e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.238225] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d148e57-65c0-48a3-9e3c-7f9dc3d97849',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.294174] env[70764]: INFO networking_nsxv3.common.synchronization [req-e3f75376-c9f4-4ddb-b2d4-2a679d0f98fc req-5cf3742b-6b9e-4d82-96b2-e5a72734dfcc tempest-ServersTestMultiNic-1176763844 tempest-ServersTestMultiNic-1176763844-project-member] Enqueued Resource ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 with Priority: HIGHEST for action security_group_members [ 1194.294174] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 with Priority: HIGHEST for action security_group_members [ 1194.294428] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.294428] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.392558] env[70764]: INFO networking_nsxv3.common.synchronization [req-de6c6928-c87c-4c28-920d-bf6e65c41905 req-55a49b69-9885-4ce9-976b-89d7039a383d tempest-AttachInterfacesTestJSON-1880347664 tempest-AttachInterfacesTestJSON-1880347664-project-member] Enqueued Resource ID: 6df71822-ed7d-4644-87b5-30eb51293fdd with Priority: HIGHEST for action security_group_members [ 1194.393780] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6df71822-ed7d-4644-87b5-30eb51293fdd with Priority: HIGHEST for action security_group_members [ 1194.393780] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-6df71822-ed7d-4644-87b5-30eb51293fdd taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.393780] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6df71822-ed7d-4644-87b5-30eb51293fdd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.393780] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6df71822-ed7d-4644-87b5-30eb51293fdd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.394245] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6df71822-ed7d-4644-87b5-30eb51293fdd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.394431] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.394540] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.394601] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.394828] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.395158] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.395330] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6df71822-ed7d-4644-87b5-30eb51293fdd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.621431] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 01588700-3c33-4723-87f1-c5abc176445e: rpc.has_security_group_logging(os_id): False [ 1194.639231] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.639384] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.639449] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.639672] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.639765] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.639953] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.640061] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.640119] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.640264] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.640340] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.640532] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.640624] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.640682] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.640819] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.640891] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.641095] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.641188] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.641243] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.641379] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.641452] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.641535] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01588700-3c33-4723-87f1-c5abc176445e is going to be updated. [ 1194.681695] env[70764]: INFO networking_nsxv3.common.synchronization [req-e3f75376-c9f4-4ddb-b2d4-2a679d0f98fc req-378276ef-8e46-42dc-8e6f-a5b4cbe26d5d tempest-ServersTestMultiNic-1176763844 tempest-ServersTestMultiNic-1176763844-project-member] Enqueued Resource ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 with Priority: HIGHEST for action security_group_members [ 1194.681947] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 with Priority: HIGHEST for action security_group_members [ 1194.682489] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.682587] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.698640] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.698786] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.698905] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.699621] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.699621] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.714092] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01588700-3c33-4723-87f1-c5abc176445e in Status: IN_PROGRESS for 2s [ 1194.741481] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d148e57-65c0-48a3-9e3c-7f9dc3d97849',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.900247] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.900247] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.900247] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.900247] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.900247] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.900247] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.900247] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.900247] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.900247] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.900247] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.900247] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6df71822-ed7d-4644-87b5-30eb51293fdd is going to be updated. [ 1194.928979] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.928979] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.928979] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.928979] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.928979] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.936537] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6df71822-ed7d-4644-87b5-30eb51293fdd in Status: IN_PROGRESS for 2s [ 1195.244564] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.244917] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.244917] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.245375] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.245375] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.245375] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 is going to be updated. [ 1195.278148] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.278148] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.278148] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.278148] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.278148] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.288313] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 in Status: IN_PROGRESS for 2s [ 1195.404645] env[70764]: INFO networking_nsxv3.common.synchronization [req-b5b7158f-e560-47ef-9d72-ae143c954e5c req-56903184-c4c5-4a14-858f-80f48158eb21 tempest-ServerActionsTestJSON-288318646 tempest-ServerActionsTestJSON-288318646-project-member] Enqueued Resource ID: 527aa039-9b45-4682-bffb-ac71e24551a1 with Priority: HIGHEST for action security_group_members [ 1195.405377] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 527aa039-9b45-4682-bffb-ac71e24551a1 with Priority: HIGHEST for action security_group_members [ 1195.405612] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-527aa039-9b45-4682-bffb-ac71e24551a1 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.405812] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.409012] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.409216] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.409407] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.409900] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.410072] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.410239] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.410497] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.410497] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('527aa039-9b45-4682-bffb-ac71e24551a1',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.724650] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 in Status: SUCCESS [ 1195.724978] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.725621] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.725621] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.725621] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d148e57-65c0-48a3-9e3c-7f9dc3d97849',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.913170] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.913350] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.913429] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.913724] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.933988] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.934371] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.934521] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.934590] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.934925] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.935068] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.935163] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 527aa039-9b45-4682-bffb-ac71e24551a1 is going to be updated. [ 1195.958850] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.958998] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.959055] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.959275] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.959487] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.967178] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 527aa039-9b45-4682-bffb-ac71e24551a1 in Status: IN_PROGRESS for 2s [ 1196.251210] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.251594] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.251594] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.251594] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.251808] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.251808] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 is going to be deleted. [ 1196.306998] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.307281] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.307345] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.307524] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.307628] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.307811] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.731448] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01588700-3c33-4723-87f1-c5abc176445e in Status: SUCCESS [ 1196.731854] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.948871] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6df71822-ed7d-4644-87b5-30eb51293fdd in Status: SUCCESS [ 1196.949249] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6df71822-ed7d-4644-87b5-30eb51293fdd deletion is rescheduled due to dependency. [ 1196.949476] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6df71822-ed7d-4644-87b5-30eb51293fdd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.301061] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 in Status: SUCCESS [ 1197.301061] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.301480] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.301480] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.301614] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.301674] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.301711] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.301866] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.301946] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.302052] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d148e57-65c0-48a3-9e3c-7f9dc3d97849',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.804647] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.804845] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.804942] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.805177] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.805273] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.805477] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.805573] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.805634] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.805790] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.805885] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.805984] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 is going to be deleted. [ 1197.837037] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.837037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.837308] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.837308] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.837374] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.837461] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.837613] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.837766] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.837926] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.838041] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.838104] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.838241] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.838315] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.838409] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d148e57-65c0-48a3-9e3c-7f9dc3d97849',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.977382] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 527aa039-9b45-4682-bffb-ac71e24551a1 in Status: SUCCESS [ 1197.977597] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 527aa039-9b45-4682-bffb-ac71e24551a1 deletion is rescheduled due to dependency. [ 1197.977842] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.341925] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.342276] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.342460] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.342632] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.342791] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.343113] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.343301] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.343513] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.343662] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.343802] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.343950] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 already deleted. [ 1198.344112] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.829284] env[70764]: INFO networking_nsxv3.common.synchronization [None req-f2858051-4b17-407c-a502-ee7ba4e6a64e None None] Enqueued Resource ID: 304a99da-8541-420b-825c-5b76a223b44c with Priority: HIGHEST for action port [ 1198.829687] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 304a99da-8541-420b-825c-5b76a223b44c with Priority: HIGHEST for action port [ 1198.830152] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-304a99da-8541-420b-825c-5b76a223b44c taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.830475] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-304a99da-8541-420b-825c-5b76a223b44c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.830475] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-304a99da-8541-420b-825c-5b76a223b44c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.830663] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-304a99da-8541-420b-825c-5b76a223b44c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.830832] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('304a99da-8541-420b-825c-5b76a223b44c',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.333069] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 304a99da-8541-420b-825c-5b76a223b44c [ 1199.333310] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.333447] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.333514] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.333724] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.333814] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.333910] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:304a99da-8541-420b-825c-5b76a223b44c already deleted. [ 1199.333988] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-304a99da-8541-420b-825c-5b76a223b44c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.411384] env[70764]: INFO networking_nsxv3.common.synchronization [None req-df018646-57ae-4037-83e6-d6fff366a93e tempest-ServerActionsTestOtherA-1368461845 tempest-ServerActionsTestOtherA-1368461845-project-member] Enqueued Resource ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 with Priority: HIGHEST for action security_group_rules [ 1199.411914] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 with Priority: HIGHEST for action security_group_rules [ 1199.412227] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70063452-8c8c-4112-a7fa-5e8224b914d5 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.412348] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.412414] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.412655] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.412800] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70063452-8c8c-4112-a7fa-5e8224b914d5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.487784] env[70764]: INFO networking_nsxv3.common.synchronization [None req-e6a53078-2361-4cf8-b76c-7eab45576d42 tempest-ServerActionsTestOtherA-1368461845 tempest-ServerActionsTestOtherA-1368461845-project-member] Enqueued Resource ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 with Priority: HIGHEST for action security_group_rules [ 1199.488227] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 with Priority: HIGHEST for action security_group_rules [ 1199.488526] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70063452-8c8c-4112-a7fa-5e8224b914d5 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.488638] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.933787] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.933968] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.934050] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.934347] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.934546] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.934715] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 already deleted. [ 1199.934927] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.935204] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.935835] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.935835] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70063452-8c8c-4112-a7fa-5e8224b914d5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.458952] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.458952] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.458952] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.458952] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.458952] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.458952] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 already deleted. [ 1200.458952] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.991150] env[70764]: INFO networking_nsxv3.common.synchronization [None req-b6fa07f6-71ed-4796-82dd-5044be571353 None None] Enqueued Resource ID: b589c534-8c6b-47af-b4ef-ea786cd9bcac with Priority: HIGHEST for action port [ 1200.991739] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b589c534-8c6b-47af-b4ef-ea786cd9bcac with Priority: HIGHEST for action port [ 1200.992268] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-b589c534-8c6b-47af-b4ef-ea786cd9bcac taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.992458] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b589c534-8c6b-47af-b4ef-ea786cd9bcac" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.992530] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b589c534-8c6b-47af-b4ef-ea786cd9bcac" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.992792] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b589c534-8c6b-47af-b4ef-ea786cd9bcac" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.992890] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b589c534-8c6b-47af-b4ef-ea786cd9bcac',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.495614] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b589c534-8c6b-47af-b4ef-ea786cd9bcac [ 1201.495614] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.495992] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.495992] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.496188] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.496331] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.496463] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b589c534-8c6b-47af-b4ef-ea786cd9bcac already deleted. [ 1201.496571] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b589c534-8c6b-47af-b4ef-ea786cd9bcac" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.125012] env[70764]: INFO networking_nsxv3.common.synchronization [None req-5744b2b0-86fd-4ebc-b133-d4b703ca8c57 tempest-AttachInterfacesTestJSON-1880347664 tempest-AttachInterfacesTestJSON-1880347664-project-member] Enqueued Resource ID: 388683b1-8e17-479d-9f16-8fe7821a0ef8 with Priority: HIGHEST for action security_group_rules [ 1202.125012] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 388683b1-8e17-479d-9f16-8fe7821a0ef8 with Priority: HIGHEST for action security_group_rules [ 1202.125012] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-388683b1-8e17-479d-9f16-8fe7821a0ef8 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.126685] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-388683b1-8e17-479d-9f16-8fe7821a0ef8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.126685] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-388683b1-8e17-479d-9f16-8fe7821a0ef8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.126685] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-388683b1-8e17-479d-9f16-8fe7821a0ef8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.126875] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('388683b1-8e17-479d-9f16-8fe7821a0ef8',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.327905] env[70764]: INFO networking_nsxv3.common.synchronization [None req-dfaffbdf-e7e7-424f-b5ff-e90fe63e5604 tempest-AttachInterfacesTestJSON-1880347664 tempest-AttachInterfacesTestJSON-1880347664-project-member] Enqueued Resource ID: 388683b1-8e17-479d-9f16-8fe7821a0ef8 with Priority: HIGHEST for action security_group_rules [ 1202.328405] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 388683b1-8e17-479d-9f16-8fe7821a0ef8 with Priority: HIGHEST for action security_group_rules [ 1202.328693] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-388683b1-8e17-479d-9f16-8fe7821a0ef8 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.328794] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-388683b1-8e17-479d-9f16-8fe7821a0ef8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.648256] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.648256] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.648256] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.648256] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.648256] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.648256] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 388683b1-8e17-479d-9f16-8fe7821a0ef8 already deleted. [ 1202.648256] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-388683b1-8e17-479d-9f16-8fe7821a0ef8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.648256] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-388683b1-8e17-479d-9f16-8fe7821a0ef8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.648256] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-388683b1-8e17-479d-9f16-8fe7821a0ef8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.648256] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('388683b1-8e17-479d-9f16-8fe7821a0ef8',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.975136] env[70764]: INFO networking_nsxv3.common.synchronization [req-c2e184cf-e580-4bd0-bf97-59a693ecba70 req-e6fae121-c746-4a4b-9be4-448a8fcaa990 tempest-ListImageFiltersTestJSON-1188056954 tempest-ListImageFiltersTestJSON-1188056954-project-member] Enqueued Resource ID: 90e38802-c5d5-43ce-9d13-c67ca1804885 with Priority: HIGHEST for action security_group_members [ 1202.975136] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90e38802-c5d5-43ce-9d13-c67ca1804885 with Priority: HIGHEST for action security_group_members [ 1202.975136] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-90e38802-c5d5-43ce-9d13-c67ca1804885 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.975136] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.975514] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.975802] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.976062] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.976299] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.976448] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.976683] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.976852] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.977032] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90e38802-c5d5-43ce-9d13-c67ca1804885',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.167232] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.167404] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.167485] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.168210] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.168486] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.168602] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 388683b1-8e17-479d-9f16-8fe7821a0ef8 already deleted. [ 1203.168713] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-388683b1-8e17-479d-9f16-8fe7821a0ef8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.479112] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.479677] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.479677] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.479677] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.479677] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.479858] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.479944] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.480010] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.480165] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.480239] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.480328] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90e38802-c5d5-43ce-9d13-c67ca1804885 is going to be updated. [ 1203.507837] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.507978] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.508061] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.508273] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.508460] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.516424] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90e38802-c5d5-43ce-9d13-c67ca1804885 in Status: IN_PROGRESS for 2s [ 1204.036048] env[70764]: INFO networking_nsxv3.common.synchronization [req-8ff7fdbf-f671-4776-a47a-328ee5dd1a59 req-f1e5240a-3893-4409-a185-46d7537f1734 tempest-AttachVolumeShelveTestJSON-384280106 tempest-AttachVolumeShelveTestJSON-384280106-project-member] Enqueued Resource ID: 4e505537-e930-46b3-bee1-b6cba5260d3d with Priority: HIGHEST for action security_group_members [ 1204.036574] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e505537-e930-46b3-bee1-b6cba5260d3d with Priority: HIGHEST for action security_group_members [ 1204.036883] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e505537-e930-46b3-bee1-b6cba5260d3d taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.037032] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.037107] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.037275] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.037428] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.037521] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.038366] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.038366] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.038366] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.038366] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e505537-e930-46b3-bee1-b6cba5260d3d',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.541144] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.541144] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.541144] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.541281] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.541310] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.541524] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.541697] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.541786] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.541988] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.542157] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.542288] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e505537-e930-46b3-bee1-b6cba5260d3d is going to be updated. [ 1204.568484] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.568484] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.568681] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.568971] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.569062] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.577117] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e505537-e930-46b3-bee1-b6cba5260d3d in Status: IN_PROGRESS for 2s [ 1205.073110] env[70764]: INFO networking_nsxv3.common.synchronization [req-7b203340-d7d1-4dd4-8be0-b1bb0b02529c req-53e8ae68-4a0d-4cd0-a2cf-366a4c587b77 tempest-MultipleCreateTestJSON-132917574 tempest-MultipleCreateTestJSON-132917574-project-member] Enqueued Resource ID: 12f4761e-3f37-4705-a034-61d725eca2f4 with Priority: HIGHEST for action security_group_members [ 1205.073600] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12f4761e-3f37-4705-a034-61d725eca2f4 with Priority: HIGHEST for action security_group_members [ 1205.074280] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-12f4761e-3f37-4705-a034-61d725eca2f4 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.074280] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.074280] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.074280] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.074498] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.074589] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.074651] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.074807] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.074950] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.075076] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12f4761e-3f37-4705-a034-61d725eca2f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.467704] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-153 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.467934] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-153" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.468073] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-153" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.468339] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-153" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.468601] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.468760] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.468877] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.469210] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.469402] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.469652] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1205.470623] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1205.470623] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1205.470623] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1205.470623] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1205.470623] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1205.470623] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1205.488926] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1205.489064] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1205.489206] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1205.489373] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-153" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.489656] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-2a2fd1ac-9711-4c33-ad45-c883fb175578 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.489819] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-2a2fd1ac-9711-4c33-ad45-c883fb175578" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.489939] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-2a2fd1ac-9711-4c33-ad45-c883fb175578" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.490265] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-2a2fd1ac-9711-4c33-ad45-c883fb175578" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.490400] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a2fd1ac-9711-4c33-ad45-c883fb175578',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.527905] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90e38802-c5d5-43ce-9d13-c67ca1804885 in Status: SUCCESS [ 1205.528028] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90e38802-c5d5-43ce-9d13-c67ca1804885 deletion is rescheduled due to dependency. [ 1205.528201] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.579386] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.580129] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.580129] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.580129] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.580275] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.580438] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.580512] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.580561] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.580731] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.580779] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.580840] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12f4761e-3f37-4705-a034-61d725eca2f4 is going to be updated. [ 1205.610587] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.610736] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.610792] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.610988] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.611136] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.619885] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12f4761e-3f37-4705-a034-61d725eca2f4 in Status: IN_PROGRESS for 2s [ 1205.994538] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.994783] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.995024] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.995480] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.995675] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.995840] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 2a2fd1ac-9711-4c33-ad45-c883fb175578 not found, creating... [ 1205.996179] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.996350] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.996470] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.996709] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.996849] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.997178] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.997340] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.997457] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.997843] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.998128] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.998294] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 2a2fd1ac-9711-4c33-ad45-c883fb175578 is going to be created. [ 1206.017275] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.017470] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.017596] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.017851] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.018119] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.018347] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-2a2fd1ac-9711-4c33-ad45-c883fb175578" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.586215] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e505537-e930-46b3-bee1-b6cba5260d3d in Status: SUCCESS [ 1206.586611] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e505537-e930-46b3-bee1-b6cba5260d3d deletion is rescheduled due to dependency. [ 1206.586611] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.691647] env[70764]: INFO networking_nsxv3.common.synchronization [req-7b203340-d7d1-4dd4-8be0-b1bb0b02529c req-031c4bb1-2136-478d-ac66-80d69135ce4b service nova] Enqueued Resource ID: 12f4761e-3f37-4705-a034-61d725eca2f4 with Priority: HIGHEST for action security_group_rules [ 1206.691802] env[70764]: INFO networking_nsxv3.common.synchronization [req-7b203340-d7d1-4dd4-8be0-b1bb0b02529c req-031c4bb1-2136-478d-ac66-80d69135ce4b service nova] Enqueued Resource ID: 12f4761e-3f37-4705-a034-61d725eca2f4 with Priority: HIGHEST for action security_group_members [ 1206.691900] env[70764]: INFO networking_nsxv3.common.synchronization [req-7b203340-d7d1-4dd4-8be0-b1bb0b02529c req-031c4bb1-2136-478d-ac66-80d69135ce4b service nova] Enqueued Resource ID: 2a2fd1ac-9711-4c33-ad45-c883fb175578 with Priority: HIGHEST for action port [ 1206.692154] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12f4761e-3f37-4705-a034-61d725eca2f4 with Priority: HIGHEST for action security_group_rules [ 1206.692280] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12f4761e-3f37-4705-a034-61d725eca2f4 with Priority: HIGHEST for action security_group_members [ 1206.692374] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a2fd1ac-9711-4c33-ad45-c883fb175578 with Priority: HIGHEST for action port [ 1206.692941] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12f4761e-3f37-4705-a034-61d725eca2f4 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.693728] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.693873] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.694195] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.694325] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12f4761e-3f37-4705-a034-61d725eca2f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.695396] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-12f4761e-3f37-4705-a034-61d725eca2f4 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.695534] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.695920] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a2fd1ac-9711-4c33-ad45-c883fb175578 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.696605] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a2fd1ac-9711-4c33-ad45-c883fb175578" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.697413] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a2fd1ac-9711-4c33-ad45-c883fb175578" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.697413] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a2fd1ac-9711-4c33-ad45-c883fb175578" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.697413] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a2fd1ac-9711-4c33-ad45-c883fb175578',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.198982] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-12f4761e-3f37-4705-a034-61d725eca2f4 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.199124] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.199306] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2a2fd1ac-9711-4c33-ad45-c883fb175578 with status ACTIVE [ 1207.199487] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.201017] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.201017] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.201017] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.201017] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.201017] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.201017] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.201017] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.201017] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.201017] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.201017] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.201017] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.201017] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.201017] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.201017] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.201468] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2a2fd1ac-9711-4c33-ad45-c883fb175578 is going to be updated. [ 1207.219595] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.219740] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.219799] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.219981] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.220134] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.220286] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a2fd1ac-9711-4c33-ad45-c883fb175578" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.237860] env[70764]: INFO networking_nsxv3.common.synchronization [req-7b203340-d7d1-4dd4-8be0-b1bb0b02529c req-356dda92-1b8f-4d48-86ac-6ec7548a4a21 tempest-MultipleCreateTestJSON-132917574 tempest-MultipleCreateTestJSON-132917574-project-member] Enqueued Resource ID: 12f4761e-3f37-4705-a034-61d725eca2f4 with Priority: HIGHEST for action security_group_members [ 1207.238370] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12f4761e-3f37-4705-a034-61d725eca2f4 with Priority: HIGHEST for action security_group_members [ 1207.238668] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-12f4761e-3f37-4705-a034-61d725eca2f4 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.238772] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.607866] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-153 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.608198] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-153" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.608198] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-153" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.608473] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-153" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.608735] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.608898] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.609030] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.609293] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.609449] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.609702] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1207.609781] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1207.609881] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1207.609992] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1207.610128] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1207.610240] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1207.610375] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1207.628371] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12f4761e-3f37-4705-a034-61d725eca2f4 in Status: SUCCESS [ 1207.628531] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12f4761e-3f37-4705-a034-61d725eca2f4 deletion is rescheduled due to dependency. [ 1207.628639] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.628781] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.628975] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.629173] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.629279] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.629346] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.629486] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.629577] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.629670] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12f4761e-3f37-4705-a034-61d725eca2f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.631721] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1207.631883] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1207.632064] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1207.632189] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-153" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.632455] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-b70cb87f-e2c8-40b1-82d1-34e1a7f76154 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.632624] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-b70cb87f-e2c8-40b1-82d1-34e1a7f76154" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.632733] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-b70cb87f-e2c8-40b1-82d1-34e1a7f76154" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.633078] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-b70cb87f-e2c8-40b1-82d1-34e1a7f76154" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.633237] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b70cb87f-e2c8-40b1-82d1-34e1a7f76154',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.131338] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('12f4761e-3f37-4705-a034-61d725eca2f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.135162] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.135375] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.135501] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.135772] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.135926] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.136118] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port b70cb87f-e2c8-40b1-82d1-34e1a7f76154 not found, creating... [ 1208.136547] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.136547] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.136670] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.136861] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.136999] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.137390] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.137577] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.137697] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.137917] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.138121] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.138358] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: b70cb87f-e2c8-40b1-82d1-34e1a7f76154 is going to be created. [ 1208.157766] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.157766] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.157929] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.158159] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.158392] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.158700] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-b70cb87f-e2c8-40b1-82d1-34e1a7f76154" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.633478] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('12f4761e-3f37-4705-a034-61d725eca2f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.983393] env[70764]: INFO networking_nsxv3.common.synchronization [req-7b203340-d7d1-4dd4-8be0-b1bb0b02529c req-e279d991-90b3-483f-bcba-2d73e18db8eb service nova] Enqueued Resource ID: 12f4761e-3f37-4705-a034-61d725eca2f4 with Priority: HIGHEST for action security_group_rules [ 1208.983574] env[70764]: INFO networking_nsxv3.common.synchronization [req-7b203340-d7d1-4dd4-8be0-b1bb0b02529c req-e279d991-90b3-483f-bcba-2d73e18db8eb service nova] Enqueued Resource ID: 12f4761e-3f37-4705-a034-61d725eca2f4 with Priority: HIGHEST for action security_group_members [ 1208.983714] env[70764]: INFO networking_nsxv3.common.synchronization [req-7b203340-d7d1-4dd4-8be0-b1bb0b02529c req-e279d991-90b3-483f-bcba-2d73e18db8eb service nova] Enqueued Resource ID: b70cb87f-e2c8-40b1-82d1-34e1a7f76154 with Priority: HIGHEST for action port [ 1208.983947] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12f4761e-3f37-4705-a034-61d725eca2f4 with Priority: HIGHEST for action security_group_rules [ 1208.984087] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12f4761e-3f37-4705-a034-61d725eca2f4 with Priority: HIGHEST for action security_group_members [ 1208.984181] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b70cb87f-e2c8-40b1-82d1-34e1a7f76154 with Priority: HIGHEST for action port [ 1208.984696] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12f4761e-3f37-4705-a034-61d725eca2f4 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.984801] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.985109] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-12f4761e-3f37-4705-a034-61d725eca2f4 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.985220] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.985490] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-b70cb87f-e2c8-40b1-82d1-34e1a7f76154 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.985644] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b70cb87f-e2c8-40b1-82d1-34e1a7f76154" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.985722] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b70cb87f-e2c8-40b1-82d1-34e1a7f76154" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.985919] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b70cb87f-e2c8-40b1-82d1-34e1a7f76154" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.986013] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b70cb87f-e2c8-40b1-82d1-34e1a7f76154',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.135803] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.135977] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.136061] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.136277] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.136369] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.136471] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12f4761e-3f37-4705-a034-61d725eca2f4 is going to be updated. [ 1209.163033] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.163176] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.163253] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.163468] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.163626] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.172412] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12f4761e-3f37-4705-a034-61d725eca2f4 in Status: IN_PROGRESS for 2s [ 1209.479102] env[70764]: INFO networking_nsxv3.common.synchronization [req-96d58dec-469c-4e65-bbd3-5cd806560153 req-fb40e721-5406-4992-b726-0c204920bccc tempest-ServerActionsTestOtherA-1368461845 tempest-ServerActionsTestOtherA-1368461845-project-member] Enqueued Resource ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 with Priority: HIGHEST for action security_group_members [ 1209.479102] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 with Priority: HIGHEST for action security_group_members [ 1209.479102] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-70063452-8c8c-4112-a7fa-5e8224b914d5 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.479102] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.479102] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.479102] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.479102] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.479102] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.479102] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.479102] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.479838] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.480029] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70063452-8c8c-4112-a7fa-5e8224b914d5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.490037] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b70cb87f-e2c8-40b1-82d1-34e1a7f76154 with status ACTIVE [ 1209.490037] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.490037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.490037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.490037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.490037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.490037] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.490037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.490037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.490037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.490037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.490037] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.490037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.490037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.490037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.490037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.490037] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b70cb87f-e2c8-40b1-82d1-34e1a7f76154 is going to be updated. [ 1209.512668] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.512668] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.512668] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.512668] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.512668] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.512668] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b70cb87f-e2c8-40b1-82d1-34e1a7f76154" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.943471] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-388 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.943815] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-388" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.943815] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-388" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.944138] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-388" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.944409] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.944573] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.944693] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.944910] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.945112] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.945325] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1209.945440] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1209.945550] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1209.945656] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1209.945763] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1209.945904] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1209.946062] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1209.966744] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1209.966896] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1209.967046] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1209.967217] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-388" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.967572] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-6c399517-1060-41a9-9e57-1925e34a7727 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.967743] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-6c399517-1060-41a9-9e57-1925e34a7727" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.967863] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-6c399517-1060-41a9-9e57-1925e34a7727" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.968167] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-6c399517-1060-41a9-9e57-1925e34a7727" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.968310] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c399517-1060-41a9-9e57-1925e34a7727',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.981895] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.982041] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.982088] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.982237] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.982319] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.982496] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.982594] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.982657] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.982796] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.982915] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.982981] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 already deleted. [ 1209.983030] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.471954] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.472236] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.472321] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.472607] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.472778] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.472957] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 6c399517-1060-41a9-9e57-1925e34a7727 not found, creating... [ 1210.473726] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.473726] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.473726] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.473726] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.473927] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.474348] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.474348] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.474497] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.474675] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.474811] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.475355] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 6c399517-1060-41a9-9e57-1925e34a7727 is going to be created. [ 1210.500045] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.500231] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.500361] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.500592] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.500837] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.501081] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-6c399517-1060-41a9-9e57-1925e34a7727" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.182272] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12f4761e-3f37-4705-a034-61d725eca2f4 in Status: SUCCESS [ 1211.182540] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.182615] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.183063] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.183142] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.183211] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.183286] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.183460] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.183546] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.183603] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.183716] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('12f4761e-3f37-4705-a034-61d725eca2f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.185370] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.185370] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.185370] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.185370] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.185661] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.185661] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.185661] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.185826] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12f4761e-3f37-4705-a034-61d725eca2f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.328349] env[70764]: INFO networking_nsxv3.common.synchronization [req-96d58dec-469c-4e65-bbd3-5cd806560153 req-a9c971a4-aac2-44c6-b90e-49c268018d8f service nova] Enqueued Resource ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 with Priority: HIGHEST for action security_group_rules [ 1211.328349] env[70764]: INFO networking_nsxv3.common.synchronization [req-96d58dec-469c-4e65-bbd3-5cd806560153 req-a9c971a4-aac2-44c6-b90e-49c268018d8f service nova] Enqueued Resource ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 with Priority: HIGHEST for action security_group_members [ 1211.328349] env[70764]: INFO networking_nsxv3.common.synchronization [req-96d58dec-469c-4e65-bbd3-5cd806560153 req-a9c971a4-aac2-44c6-b90e-49c268018d8f service nova] Enqueued Resource ID: 6c399517-1060-41a9-9e57-1925e34a7727 with Priority: HIGHEST for action port [ 1211.328349] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 with Priority: HIGHEST for action security_group_rules [ 1211.328349] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 with Priority: HIGHEST for action security_group_members [ 1211.328349] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c399517-1060-41a9-9e57-1925e34a7727 with Priority: HIGHEST for action port [ 1211.328349] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70063452-8c8c-4112-a7fa-5e8224b914d5 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.328349] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.328349] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.329517] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.329734] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70063452-8c8c-4112-a7fa-5e8224b914d5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.330737] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-70063452-8c8c-4112-a7fa-5e8224b914d5 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.333116] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.333116] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.333116] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.333116] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.333116] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.333116] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.333116] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.333116] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.333116] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70063452-8c8c-4112-a7fa-5e8224b914d5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.333116] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c399517-1060-41a9-9e57-1925e34a7727 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.333759] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c399517-1060-41a9-9e57-1925e34a7727" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.333947] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c399517-1060-41a9-9e57-1925e34a7727" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.334249] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c399517-1060-41a9-9e57-1925e34a7727" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.334520] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c399517-1060-41a9-9e57-1925e34a7727',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.689078] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('12f4761e-3f37-4705-a034-61d725eca2f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.689562] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-12f4761e-3f37-4705-a034-61d725eca2f4 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.689668] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.836394] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-70063452-8c8c-4112-a7fa-5e8224b914d5 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.836544] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.836735] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('70063452-8c8c-4112-a7fa-5e8224b914d5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.837710] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6c399517-1060-41a9-9e57-1925e34a7727 with status ACTIVE [ 1211.838434] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.838434] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.838434] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.838434] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.838434] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.838679] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.838679] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.838679] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.838866] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.838866] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.844666] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.844666] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.844666] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.844666] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.844666] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.844666] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6c399517-1060-41a9-9e57-1925e34a7727 is going to be updated. [ 1211.866883] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.867050] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.867111] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.867331] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.867468] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.867653] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c399517-1060-41a9-9e57-1925e34a7727" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.192154] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('12f4761e-3f37-4705-a034-61d725eca2f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.346573] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('70063452-8c8c-4112-a7fa-5e8224b914d5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.695639] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.695782] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.695853] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.696333] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.696411] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.696515] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12f4761e-3f37-4705-a034-61d725eca2f4 is going to be updated. [ 1212.726291] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.726291] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.726291] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.726291] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.726291] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.732499] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12f4761e-3f37-4705-a034-61d725eca2f4 in Status: IN_PROGRESS for 2s [ 1212.851507] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.851697] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.851736] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.851935] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.852032] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.852139] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 is going to be created. [ 1212.874802] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.874942] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.875095] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.875308] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.875461] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.885743] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 in Status: UNINITIALIZED for 2s [ 1213.367100] env[70764]: INFO networking_nsxv3.common.synchronization [None req-9bdb9e63-3ec5-4184-8c26-101c15ccc3fa None None] Enqueued Resource ID: 4cefb1b2-1eda-4c70-9b1f-eeec18395c95 with Priority: HIGHEST for action port [ 1213.367100] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cefb1b2-1eda-4c70-9b1f-eeec18395c95 with Priority: HIGHEST for action port [ 1213.367100] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-4cefb1b2-1eda-4c70-9b1f-eeec18395c95 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.367100] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4cefb1b2-1eda-4c70-9b1f-eeec18395c95" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.367100] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4cefb1b2-1eda-4c70-9b1f-eeec18395c95" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.368053] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4cefb1b2-1eda-4c70-9b1f-eeec18395c95" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.368248] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4cefb1b2-1eda-4c70-9b1f-eeec18395c95',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.570604] env[70764]: INFO networking_nsxv3.common.synchronization [req-91ae88fb-a5b8-44dc-b204-6ea35f065d08 req-631a5897-f057-4e10-ae7a-98ab8c6365a6 tempest-ServerActionsTestJSON-288318646 tempest-ServerActionsTestJSON-288318646-project-member] Enqueued Resource ID: 527aa039-9b45-4682-bffb-ac71e24551a1 with Priority: HIGHEST for action security_group_members [ 1213.570604] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 527aa039-9b45-4682-bffb-ac71e24551a1 with Priority: HIGHEST for action security_group_members [ 1213.571335] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-527aa039-9b45-4682-bffb-ac71e24551a1 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.572776] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.573000] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.573445] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.573780] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.574723] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.574723] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.574723] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.576046] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.576046] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('527aa039-9b45-4682-bffb-ac71e24551a1',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.874383] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4cefb1b2-1eda-4c70-9b1f-eeec18395c95 [ 1213.875219] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.875219] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.875219] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.875219] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.875219] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.875567] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4cefb1b2-1eda-4c70-9b1f-eeec18395c95 already deleted. [ 1213.875567] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4cefb1b2-1eda-4c70-9b1f-eeec18395c95" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.078518] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.078670] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.078767] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.078966] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.079076] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.079306] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.079397] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.079457] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.079617] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.079696] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.079781] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 527aa039-9b45-4682-bffb-ac71e24551a1 is going to be updated. [ 1214.103668] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.105092] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.105197] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.105414] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.105562] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.119245] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 527aa039-9b45-4682-bffb-ac71e24551a1 in Status: IN_PROGRESS for 2s [ 1214.131354] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-803 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.131559] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-803" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.131683] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-803" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.131959] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-803" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.132265] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.132610] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.132744] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.132994] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.133170] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.133390] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1214.133507] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1214.133617] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1214.133728] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1214.133840] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1214.133948] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1214.134098] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1214.157371] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1214.157570] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1214.157714] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1214.157897] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-803" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.158456] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-24495308-5844-4ac8-b13a-c52672d25c10 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.158675] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-24495308-5844-4ac8-b13a-c52672d25c10" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.158801] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-24495308-5844-4ac8-b13a-c52672d25c10" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.159140] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-24495308-5844-4ac8-b13a-c52672d25c10" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.159284] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24495308-5844-4ac8-b13a-c52672d25c10',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.663583] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.663861] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.663957] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.664264] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.664423] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.664584] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 24495308-5844-4ac8-b13a-c52672d25c10 not found, creating... [ 1214.664854] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.665073] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.665219] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.665437] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.665577] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.665865] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.670191] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.670191] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.670191] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.670191] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.670191] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 24495308-5844-4ac8-b13a-c52672d25c10 is going to be created. [ 1214.687585] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.687721] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.687850] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.688148] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.688587] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.688626] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-24495308-5844-4ac8-b13a-c52672d25c10" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.744956] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12f4761e-3f37-4705-a034-61d725eca2f4 in Status: SUCCESS [ 1214.744956] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.744956] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.745394] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.745859] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.745984] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.746073] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.746410] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.746410] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.746966] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12f4761e-3f37-4705-a034-61d725eca2f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.900799] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 in Status: SUCCESS [ 1214.901143] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.901365] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.901621] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.901870] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.902139] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.902139] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.902337] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.902445] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.902537] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.902660] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('70063452-8c8c-4112-a7fa-5e8224b914d5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.250136] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('12f4761e-3f37-4705-a034-61d725eca2f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.406472] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('70063452-8c8c-4112-a7fa-5e8224b914d5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.561746] env[70764]: INFO networking_nsxv3.common.synchronization [req-91ae88fb-a5b8-44dc-b204-6ea35f065d08 req-8d895711-990d-4f7b-9d48-074e34fe635f service nova] Enqueued Resource ID: 527aa039-9b45-4682-bffb-ac71e24551a1 with Priority: HIGHEST for action security_group_rules [ 1215.561890] env[70764]: INFO networking_nsxv3.common.synchronization [req-91ae88fb-a5b8-44dc-b204-6ea35f065d08 req-8d895711-990d-4f7b-9d48-074e34fe635f service nova] Enqueued Resource ID: 527aa039-9b45-4682-bffb-ac71e24551a1 with Priority: HIGHEST for action security_group_members [ 1215.562052] env[70764]: INFO networking_nsxv3.common.synchronization [req-91ae88fb-a5b8-44dc-b204-6ea35f065d08 req-8d895711-990d-4f7b-9d48-074e34fe635f service nova] Enqueued Resource ID: 24495308-5844-4ac8-b13a-c52672d25c10 with Priority: HIGHEST for action port [ 1215.562565] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 527aa039-9b45-4682-bffb-ac71e24551a1 with Priority: HIGHEST for action security_group_rules [ 1215.562696] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 527aa039-9b45-4682-bffb-ac71e24551a1 with Priority: HIGHEST for action security_group_members [ 1215.562791] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24495308-5844-4ac8-b13a-c52672d25c10 with Priority: HIGHEST for action port [ 1215.563497] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-527aa039-9b45-4682-bffb-ac71e24551a1 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.563704] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.563704] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.563883] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.563963] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('527aa039-9b45-4682-bffb-ac71e24551a1',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.567900] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-527aa039-9b45-4682-bffb-ac71e24551a1 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.567900] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.567900] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-24495308-5844-4ac8-b13a-c52672d25c10 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.567900] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-24495308-5844-4ac8-b13a-c52672d25c10" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.567900] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-24495308-5844-4ac8-b13a-c52672d25c10" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.567900] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-24495308-5844-4ac8-b13a-c52672d25c10" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.567900] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24495308-5844-4ac8-b13a-c52672d25c10',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.589673] env[70764]: INFO networking_nsxv3.common.synchronization [None req-62794f01-231e-4b2a-9edc-3d69161b14ad None None] Enqueued Resource ID: 5e69a7d9-77ec-436a-977d-44d07c15b03b with Priority: HIGHEST for action port [ 1215.591067] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e69a7d9-77ec-436a-977d-44d07c15b03b with Priority: HIGHEST for action port [ 1215.591627] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e69a7d9-77ec-436a-977d-44d07c15b03b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.591756] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e69a7d9-77ec-436a-977d-44d07c15b03b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.591826] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e69a7d9-77ec-436a-977d-44d07c15b03b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.592088] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e69a7d9-77ec-436a-977d-44d07c15b03b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.592193] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e69a7d9-77ec-436a-977d-44d07c15b03b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.752429] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('12f4761e-3f37-4705-a034-61d725eca2f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.914033] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 70063452-8c8c-4112-a7fa-5e8224b914d5: rpc.has_security_group_logging(os_id): False [ 1215.931159] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.931159] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.931159] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.931159] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.931396] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.931486] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.931589] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.931649] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.931797] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.931902] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.931953] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 is going to be created. [ 1215.988077] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.988245] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.988311] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.988531] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.988719] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.997608] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 in Status: IN_PROGRESS for 2s [ 1216.068619] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-527aa039-9b45-4682-bffb-ac71e24551a1 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.068801] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.070096] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 24495308-5844-4ac8-b13a-c52672d25c10 with status ACTIVE [ 1216.070296] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.070418] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.070490] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.070700] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.070786] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.070983] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.071121] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.071192] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.071294] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.071462] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.071561] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.071644] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.071689] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.071821] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.071898] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.071982] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 24495308-5844-4ac8-b13a-c52672d25c10 is going to be updated. [ 1216.093891] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5e69a7d9-77ec-436a-977d-44d07c15b03b [ 1216.094182] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.094328] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.094398] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.094614] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.094705] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.094808] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5e69a7d9-77ec-436a-977d-44d07c15b03b already deleted. [ 1216.094889] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e69a7d9-77ec-436a-977d-44d07c15b03b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.097309] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.097472] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.097512] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.097690] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.097819] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.097970] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-24495308-5844-4ac8-b13a-c52672d25c10" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.128205] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 527aa039-9b45-4682-bffb-ac71e24551a1 in Status: SUCCESS [ 1216.128399] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 527aa039-9b45-4682-bffb-ac71e24551a1 deletion is rescheduled due to dependency. [ 1216.128521] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.128681] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.128913] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.129123] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.129246] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.129311] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.129472] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.129554] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.129648] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('527aa039-9b45-4682-bffb-ac71e24551a1',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.255309] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.255309] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.255511] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.255598] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.255714] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.255853] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12f4761e-3f37-4705-a034-61d725eca2f4 is going to be updated. [ 1216.284684] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.284684] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.284684] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.284684] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.284684] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.296907] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12f4761e-3f37-4705-a034-61d725eca2f4 in Status: IN_PROGRESS for 2s [ 1216.632174] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('527aa039-9b45-4682-bffb-ac71e24551a1',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.133892] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('527aa039-9b45-4682-bffb-ac71e24551a1',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.400316] env[70764]: INFO networking_nsxv3.common.synchronization [req-ee6b8452-02ab-4b6d-abc9-b612335da81c req-9107ca7a-f08a-43de-a185-9c9ac3786876 tempest-AttachInterfacesTestJSON-1880347664 tempest-AttachInterfacesTestJSON-1880347664-project-member] Enqueued Resource ID: 388683b1-8e17-479d-9f16-8fe7821a0ef8 with Priority: HIGHEST for action security_group_members [ 1217.400316] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 388683b1-8e17-479d-9f16-8fe7821a0ef8 with Priority: HIGHEST for action security_group_members [ 1217.400316] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-388683b1-8e17-479d-9f16-8fe7821a0ef8 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.400316] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-388683b1-8e17-479d-9f16-8fe7821a0ef8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.400316] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-388683b1-8e17-479d-9f16-8fe7821a0ef8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.400316] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-388683b1-8e17-479d-9f16-8fe7821a0ef8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.400316] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.400316] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.400316] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.400316] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.400934] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.401180] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('388683b1-8e17-479d-9f16-8fe7821a0ef8',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.636932] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.636932] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.636932] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.637244] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.637337] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.637462] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 527aa039-9b45-4682-bffb-ac71e24551a1 is going to be updated. [ 1217.664303] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.664543] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.664671] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.665378] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.669018] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.674079] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 527aa039-9b45-4682-bffb-ac71e24551a1 in Status: IN_PROGRESS for 2s [ 1217.806514] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-822 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.806732] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-822" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.806859] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-822" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.807161] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-822" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.807432] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.807594] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.807710] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.807923] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.808087] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.808297] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1217.808409] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1217.808516] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1217.808623] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1217.808731] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1217.808837] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1217.808971] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1217.828012] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1217.828183] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1217.828327] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1217.828496] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-822" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.828778] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-83330714-f902-4538-bede-1a9d147753d0 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.828944] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-83330714-f902-4538-bede-1a9d147753d0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.829098] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-83330714-f902-4538-bede-1a9d147753d0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.829453] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-83330714-f902-4538-bede-1a9d147753d0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.829600] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83330714-f902-4538-bede-1a9d147753d0',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.905809] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.905990] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.906081] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.906323] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.906416] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.906615] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.906715] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.906792] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.907060] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.907244] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.907350] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 388683b1-8e17-479d-9f16-8fe7821a0ef8 already deleted. [ 1217.907438] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-388683b1-8e17-479d-9f16-8fe7821a0ef8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.009702] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 in Status: SUCCESS [ 1218.009702] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.306220] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12f4761e-3f37-4705-a034-61d725eca2f4 in Status: SUCCESS [ 1218.306523] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.306523] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.306783] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.306881] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.306996] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.307079] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.307311] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.307371] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.307447] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.307600] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-12f4761e-3f37-4705-a034-61d725eca2f4 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.307707] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.307767] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.307922] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.311664] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.311664] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.311778] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.313440] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.313440] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.313440] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.313440] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('12f4761e-3f37-4705-a034-61d725eca2f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.331666] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.331888] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.332020] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.332360] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.332517] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.332612] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 83330714-f902-4538-bede-1a9d147753d0 not found, creating... [ 1218.332882] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.333068] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.333176] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.333398] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.333535] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.333840] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.334013] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.334196] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.334423] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.334585] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.335351] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 83330714-f902-4538-bede-1a9d147753d0 is going to be created. [ 1218.360252] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.360252] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.360252] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.360252] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.360252] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.360252] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-83330714-f902-4538-bede-1a9d147753d0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.819128] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 12f4761e-3f37-4705-a034-61d725eca2f4: rpc.has_security_group_logging(os_id): False [ 1218.836080] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.836279] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.836324] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.836512] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.836599] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.836837] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.836942] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.837022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.837192] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.837244] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.837427] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.837520] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.837579] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.837715] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.837786] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.837960] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.838065] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.838131] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.838263] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.838333] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.838417] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12f4761e-3f37-4705-a034-61d725eca2f4 is going to be updated. [ 1218.893009] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.893174] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.893244] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.893442] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.895275] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.905809] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12f4761e-3f37-4705-a034-61d725eca2f4 in Status: IN_PROGRESS for 2s [ 1219.109315] env[70764]: INFO networking_nsxv3.common.synchronization [req-ee6b8452-02ab-4b6d-abc9-b612335da81c req-2a163055-c91e-40c7-810d-4df22a9943a1 service nova] Enqueued Resource ID: 388683b1-8e17-479d-9f16-8fe7821a0ef8 with Priority: HIGHEST for action security_group_rules [ 1219.109545] env[70764]: INFO networking_nsxv3.common.synchronization [req-ee6b8452-02ab-4b6d-abc9-b612335da81c req-2a163055-c91e-40c7-810d-4df22a9943a1 service nova] Enqueued Resource ID: 388683b1-8e17-479d-9f16-8fe7821a0ef8 with Priority: HIGHEST for action security_group_members [ 1219.109714] env[70764]: INFO networking_nsxv3.common.synchronization [req-ee6b8452-02ab-4b6d-abc9-b612335da81c req-2a163055-c91e-40c7-810d-4df22a9943a1 service nova] Enqueued Resource ID: 83330714-f902-4538-bede-1a9d147753d0 with Priority: HIGHEST for action port [ 1219.110469] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 388683b1-8e17-479d-9f16-8fe7821a0ef8 with Priority: HIGHEST for action security_group_rules [ 1219.110605] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 388683b1-8e17-479d-9f16-8fe7821a0ef8 with Priority: HIGHEST for action security_group_members [ 1219.110818] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83330714-f902-4538-bede-1a9d147753d0 with Priority: HIGHEST for action port [ 1219.111279] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-388683b1-8e17-479d-9f16-8fe7821a0ef8 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.111406] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-388683b1-8e17-479d-9f16-8fe7821a0ef8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.111518] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-388683b1-8e17-479d-9f16-8fe7821a0ef8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.111802] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-388683b1-8e17-479d-9f16-8fe7821a0ef8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.111922] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('388683b1-8e17-479d-9f16-8fe7821a0ef8',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.113617] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-388683b1-8e17-479d-9f16-8fe7821a0ef8 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.113765] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-388683b1-8e17-479d-9f16-8fe7821a0ef8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.113863] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-388683b1-8e17-479d-9f16-8fe7821a0ef8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.114690] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-388683b1-8e17-479d-9f16-8fe7821a0ef8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.114925] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.115297] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.115395] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.115623] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.115767] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.115920] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('388683b1-8e17-479d-9f16-8fe7821a0ef8',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.122633] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-83330714-f902-4538-bede-1a9d147753d0 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.122821] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83330714-f902-4538-bede-1a9d147753d0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.122926] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83330714-f902-4538-bede-1a9d147753d0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.124508] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83330714-f902-4538-bede-1a9d147753d0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.124605] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83330714-f902-4538-bede-1a9d147753d0',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.627830] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-388683b1-8e17-479d-9f16-8fe7821a0ef8 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.628253] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-388683b1-8e17-479d-9f16-8fe7821a0ef8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.628253] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('388683b1-8e17-479d-9f16-8fe7821a0ef8',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.629613] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 83330714-f902-4538-bede-1a9d147753d0 with status ACTIVE [ 1219.630249] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.630388] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.630448] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.630661] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.630748] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.631103] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.631103] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.631103] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.631263] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.631309] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.631471] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.631565] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.631615] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.631753] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.631829] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.631910] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 83330714-f902-4538-bede-1a9d147753d0 is going to be updated. [ 1219.652042] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.652188] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.652250] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.652428] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.652547] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.652698] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83330714-f902-4538-bede-1a9d147753d0" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.683495] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 527aa039-9b45-4682-bffb-ac71e24551a1 in Status: SUCCESS [ 1219.683708] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.683871] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.684140] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.684332] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.684447] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.684506] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.684662] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.684741] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.684874] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.684922] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('527aa039-9b45-4682-bffb-ac71e24551a1',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.131374] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('388683b1-8e17-479d-9f16-8fe7821a0ef8',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.187353] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('527aa039-9b45-4682-bffb-ac71e24551a1',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.633785] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.634293] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.634293] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.634475] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.634475] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.634586] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 388683b1-8e17-479d-9f16-8fe7821a0ef8 is going to be created. [ 1220.657323] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.657533] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.657606] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.657833] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.658026] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.667796] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 388683b1-8e17-479d-9f16-8fe7821a0ef8 in Status: UNINITIALIZED for 2s [ 1220.691161] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 527aa039-9b45-4682-bffb-ac71e24551a1: rpc.has_security_group_logging(os_id): False [ 1220.706910] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.707101] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.707181] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.707413] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.707534] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.707826] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.707939] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.707994] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.708198] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.708279] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.708370] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 527aa039-9b45-4682-bffb-ac71e24551a1 is going to be updated. [ 1220.764872] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.765185] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.765386] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.765541] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.765690] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.777478] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 527aa039-9b45-4682-bffb-ac71e24551a1 in Status: IN_PROGRESS for 2s [ 1220.872582] env[70764]: INFO networking_nsxv3.common.synchronization [req-63b9167f-c67f-44d4-b43b-2ccd9eab5b5b req-185c0139-8e7e-4da6-88ba-c0454b286a03 tempest-MultipleCreateTestJSON-132917574 tempest-MultipleCreateTestJSON-132917574-project-member] Enqueued Resource ID: 12f4761e-3f37-4705-a034-61d725eca2f4 with Priority: HIGHEST for action security_group_members [ 1220.873154] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12f4761e-3f37-4705-a034-61d725eca2f4 with Priority: HIGHEST for action security_group_members [ 1220.873465] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-12f4761e-3f37-4705-a034-61d725eca2f4 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.873614] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.873663] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.873852] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.874013] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.874116] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.874179] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.874327] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.874409] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.874501] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12f4761e-3f37-4705-a034-61d725eca2f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.919295] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12f4761e-3f37-4705-a034-61d725eca2f4 in Status: SUCCESS [ 1220.919568] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.919774] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.920011] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.920200] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12f4761e-3f37-4705-a034-61d725eca2f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.021523] env[70764]: INFO networking_nsxv3.common.synchronization [req-882c4622-d201-4c83-be4d-380b626e5225 req-9710c601-33e9-41d8-a3ff-8b71c395096a tempest-MultipleCreateTestJSON-132917574 tempest-MultipleCreateTestJSON-132917574-project-member] Enqueued Resource ID: 12f4761e-3f37-4705-a034-61d725eca2f4 with Priority: HIGHEST for action security_group_members [ 1221.022061] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12f4761e-3f37-4705-a034-61d725eca2f4 with Priority: HIGHEST for action security_group_members [ 1221.022374] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-12f4761e-3f37-4705-a034-61d725eca2f4 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.023177] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.117375] env[70764]: INFO networking_nsxv3.common.synchronization [req-b8224842-80d6-41b9-a4e6-56ba16171d26 req-ee35b6d2-ca7d-4c44-a1a6-f24427e6765a tempest-ServersNegativeTestJSON-791332416 tempest-ServersNegativeTestJSON-791332416-project-member] Enqueued Resource ID: 01588700-3c33-4723-87f1-c5abc176445e with Priority: HIGHEST for action security_group_members [ 1221.117872] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01588700-3c33-4723-87f1-c5abc176445e with Priority: HIGHEST for action security_group_members [ 1221.118191] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-01588700-3c33-4723-87f1-c5abc176445e taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.118588] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.118588] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.118588] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.118760] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.118843] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.118902] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.119058] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.119144] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.119234] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01588700-3c33-4723-87f1-c5abc176445e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.383018] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('12f4761e-3f37-4705-a034-61d725eca2f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.405326] env[70764]: INFO networking_nsxv3.common.synchronization [req-b4979b80-b15b-4984-a108-275bdfa54370 req-11fbea41-5551-4d9e-8b97-3fef39681b90 tempest-ServersTestMultiNic-1176763844 tempest-ServersTestMultiNic-1176763844-project-member] Enqueued Resource ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 with Priority: HIGHEST for action security_group_members [ 1221.405815] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 with Priority: HIGHEST for action security_group_members [ 1221.406495] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.406629] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.406696] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.406895] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.407374] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.407526] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.407583] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.407732] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.407812] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.407906] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d148e57-65c0-48a3-9e3c-7f9dc3d97849',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.422157] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-12f4761e-3f37-4705-a034-61d725eca2f4 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.422328] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.622418] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.622666] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.622666] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.623037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.623144] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.623358] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.623462] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.623517] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.623680] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.623755] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.624065] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01588700-3c33-4723-87f1-c5abc176445e is going to be updated. [ 1221.651114] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.651114] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.651114] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.651114] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.651114] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.658696] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01588700-3c33-4723-87f1-c5abc176445e in Status: IN_PROGRESS for 2s [ 1221.673735] env[70764]: INFO networking_nsxv3.common.synchronization [req-b4979b80-b15b-4984-a108-275bdfa54370 req-ff9595e7-8712-44f9-b2e6-3a44be7032d2 tempest-ServersTestMultiNic-1176763844 tempest-ServersTestMultiNic-1176763844-project-member] Enqueued Resource ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 with Priority: HIGHEST for action security_group_members [ 1221.674958] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 with Priority: HIGHEST for action security_group_members [ 1221.675434] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.675550] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.882654] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('12f4761e-3f37-4705-a034-61d725eca2f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.913040] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.913040] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.913040] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.913040] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.913040] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.913040] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.913040] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.913040] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.913040] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.913040] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.913040] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 already deleted. [ 1221.913040] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.913040] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.913040] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.913040] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.913040] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.913040] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.913040] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.913690] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.913690] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d148e57-65c0-48a3-9e3c-7f9dc3d97849',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.965038] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-497 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.965038] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-497" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.965038] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-497" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.965038] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-497" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.965038] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.965038] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.965038] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.965038] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.965038] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.965681] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1221.965899] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1221.966110] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1221.966325] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1221.966579] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1221.966797] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1221.967309] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1221.996018] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1221.996018] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1221.996018] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1221.996018] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-497" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.996018] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-aabc0a59-23c6-4b8f-b0da-1a66d73aec52 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.996018] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-aabc0a59-23c6-4b8f-b0da-1a66d73aec52" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.996018] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-aabc0a59-23c6-4b8f-b0da-1a66d73aec52" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.996018] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-aabc0a59-23c6-4b8f-b0da-1a66d73aec52" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.996018] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aabc0a59-23c6-4b8f-b0da-1a66d73aec52',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.384740] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.384880] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.384948] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.386125] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.386125] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.386125] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12f4761e-3f37-4705-a034-61d725eca2f4 is going to be updated. [ 1222.411070] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.411279] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.411279] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.411478] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.411622] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.416369] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.416513] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.416578] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.416728] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.416809] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.416983] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.417111] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.417177] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.417319] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.417392] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.417496] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 already deleted. [ 1222.417577] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.420512] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12f4761e-3f37-4705-a034-61d725eca2f4 in Status: IN_PROGRESS for 2s [ 1222.499021] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.499211] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.499341] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.499669] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.499784] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.500029] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port aabc0a59-23c6-4b8f-b0da-1a66d73aec52 not found, creating... [ 1222.500241] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.500472] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.500681] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.500984] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.501746] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.502094] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.502277] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.502422] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.502616] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.502757] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.502901] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: aabc0a59-23c6-4b8f-b0da-1a66d73aec52 is going to be created. [ 1222.526300] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.526521] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.526750] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.526920] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.527166] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.527391] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-aabc0a59-23c6-4b8f-b0da-1a66d73aec52" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.677705] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 388683b1-8e17-479d-9f16-8fe7821a0ef8 in Status: SUCCESS [ 1222.678014] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-388683b1-8e17-479d-9f16-8fe7821a0ef8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.678169] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-388683b1-8e17-479d-9f16-8fe7821a0ef8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.678331] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-388683b1-8e17-479d-9f16-8fe7821a0ef8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.680409] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.680409] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.680409] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.680409] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.680409] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.680409] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-388683b1-8e17-479d-9f16-8fe7821a0ef8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.680409] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('388683b1-8e17-479d-9f16-8fe7821a0ef8',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.789125] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 527aa039-9b45-4682-bffb-ac71e24551a1 in Status: SUCCESS [ 1222.789549] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.181717] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('388683b1-8e17-479d-9f16-8fe7821a0ef8',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.360414] env[70764]: INFO networking_nsxv3.common.synchronization [req-b4979b80-b15b-4984-a108-275bdfa54370 req-b13d3bf4-0798-4e02-9ecc-dfa6dff1e4b7 service nova] Enqueued Resource ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 with Priority: HIGHEST for action security_group_rules [ 1223.360642] env[70764]: INFO networking_nsxv3.common.synchronization [req-b4979b80-b15b-4984-a108-275bdfa54370 req-b13d3bf4-0798-4e02-9ecc-dfa6dff1e4b7 service nova] Enqueued Resource ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 with Priority: HIGHEST for action security_group_members [ 1223.360813] env[70764]: INFO networking_nsxv3.common.synchronization [req-b4979b80-b15b-4984-a108-275bdfa54370 req-b13d3bf4-0798-4e02-9ecc-dfa6dff1e4b7 service nova] Enqueued Resource ID: aabc0a59-23c6-4b8f-b0da-1a66d73aec52 with Priority: HIGHEST for action port [ 1223.361672] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 with Priority: HIGHEST for action security_group_rules [ 1223.361848] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 with Priority: HIGHEST for action security_group_members [ 1223.362054] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aabc0a59-23c6-4b8f-b0da-1a66d73aec52 with Priority: HIGHEST for action port [ 1223.362338] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d148e57-65c0-48a3-9e3c-7f9dc3d97849 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.362492] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.362581] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.362805] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.362912] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d148e57-65c0-48a3-9e3c-7f9dc3d97849',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.363804] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.364332] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.364445] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.364687] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.364870] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.365211] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.368166] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.368332] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.368504] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.368560] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d148e57-65c0-48a3-9e3c-7f9dc3d97849',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.369303] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-aabc0a59-23c6-4b8f-b0da-1a66d73aec52 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.369521] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aabc0a59-23c6-4b8f-b0da-1a66d73aec52" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.369521] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aabc0a59-23c6-4b8f-b0da-1a66d73aec52" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.369653] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aabc0a59-23c6-4b8f-b0da-1a66d73aec52" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.369691] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aabc0a59-23c6-4b8f-b0da-1a66d73aec52',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.667303] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01588700-3c33-4723-87f1-c5abc176445e in Status: SUCCESS [ 1223.667483] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01588700-3c33-4723-87f1-c5abc176445e deletion is rescheduled due to dependency. [ 1223.667595] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.684047] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 388683b1-8e17-479d-9f16-8fe7821a0ef8: rpc.has_security_group_logging(os_id): False [ 1223.699706] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.699933] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.699933] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.700422] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.700422] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.700497] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.700573] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.700618] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.700766] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.700831] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.700923] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 388683b1-8e17-479d-9f16-8fe7821a0ef8 is going to be created. [ 1223.755325] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.755465] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.755536] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.755732] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.755908] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.766751] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 388683b1-8e17-479d-9f16-8fe7821a0ef8 in Status: IN_PROGRESS for 2s [ 1223.871903] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.872057] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.872256] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d148e57-65c0-48a3-9e3c-7f9dc3d97849',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.873345] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aabc0a59-23c6-4b8f-b0da-1a66d73aec52 with status ACTIVE [ 1223.873441] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.873538] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.873538] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.873742] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.873896] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.874053] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.874140] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.874173] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.874296] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.874366] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.874553] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.874640] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.874699] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.874836] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.874909] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.878075] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aabc0a59-23c6-4b8f-b0da-1a66d73aec52 is going to be updated. [ 1223.900537] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.900674] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.900743] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.900934] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.901076] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.901233] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aabc0a59-23c6-4b8f-b0da-1a66d73aec52" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.289631] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-620 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.290336] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-620" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.290336] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-620" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.290494] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-620" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.290775] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.290948] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.291077] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.291331] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.291680] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.291765] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1224.291881] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1224.291996] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1224.292127] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1224.292646] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1224.292646] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1224.292646] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1224.310677] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1224.311240] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1224.311499] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1224.311740] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-620" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.312519] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-1b48e306-9f6b-46bb-a433-9fbc0f602d12 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.312815] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-1b48e306-9f6b-46bb-a433-9fbc0f602d12" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.313083] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-1b48e306-9f6b-46bb-a433-9fbc0f602d12" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.313588] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-1b48e306-9f6b-46bb-a433-9fbc0f602d12" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.314051] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b48e306-9f6b-46bb-a433-9fbc0f602d12',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.379994] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d148e57-65c0-48a3-9e3c-7f9dc3d97849',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.432991] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12f4761e-3f37-4705-a034-61d725eca2f4 in Status: SUCCESS [ 1224.432991] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.432991] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.433258] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.433428] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.433544] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.433611] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.433765] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.433842] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.434151] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12f4761e-3f37-4705-a034-61d725eca2f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.818134] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.818593] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.818593] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.818777] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.818938] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.819108] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 1b48e306-9f6b-46bb-a433-9fbc0f602d12 not found, creating... [ 1224.819388] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.819550] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.819667] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.819882] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.820031] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.820318] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.820476] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.820595] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.820804] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.820941] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.821094] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 1b48e306-9f6b-46bb-a433-9fbc0f602d12 is going to be created. [ 1224.839691] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.839925] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.839996] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.840203] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.840420] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.840634] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-1b48e306-9f6b-46bb-a433-9fbc0f602d12" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.883242] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.883423] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.883491] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.883620] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.883705] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.883803] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 is going to be created. [ 1224.923113] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.923255] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.923326] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.923512] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.923663] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.936303] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.936472] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.936537] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.936697] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.936784] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.936973] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.937119] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.937151] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.937283] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.937362] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.937479] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12f4761e-3f37-4705-a034-61d725eca2f4 is going to be updated. [ 1224.939017] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 in Status: UNINITIALIZED for 2s [ 1224.983699] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.983847] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.983918] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.984139] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.984279] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.995553] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12f4761e-3f37-4705-a034-61d725eca2f4 in Status: IN_PROGRESS for 2s [ 1225.530186] env[70764]: INFO networking_nsxv3.common.synchronization [req-b4979b80-b15b-4984-a108-275bdfa54370 req-48a993df-c943-40e4-bcae-deebd8c9fecc service nova] Enqueued Resource ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 with Priority: HIGHEST for action security_group_rules [ 1225.530369] env[70764]: INFO networking_nsxv3.common.synchronization [req-b4979b80-b15b-4984-a108-275bdfa54370 req-48a993df-c943-40e4-bcae-deebd8c9fecc service nova] Enqueued Resource ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 with Priority: HIGHEST for action security_group_members [ 1225.530507] env[70764]: INFO networking_nsxv3.common.synchronization [req-b4979b80-b15b-4984-a108-275bdfa54370 req-48a993df-c943-40e4-bcae-deebd8c9fecc service nova] Enqueued Resource ID: 1b48e306-9f6b-46bb-a433-9fbc0f602d12 with Priority: HIGHEST for action port [ 1225.530732] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 with Priority: HIGHEST for action security_group_rules [ 1225.530858] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 with Priority: HIGHEST for action security_group_members [ 1225.530953] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b48e306-9f6b-46bb-a433-9fbc0f602d12 with Priority: HIGHEST for action port [ 1225.531490] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d148e57-65c0-48a3-9e3c-7f9dc3d97849 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.531632] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.531786] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.531870] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.532055] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b48e306-9f6b-46bb-a433-9fbc0f602d12 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.532162] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b48e306-9f6b-46bb-a433-9fbc0f602d12" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.532228] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b48e306-9f6b-46bb-a433-9fbc0f602d12" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.532422] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b48e306-9f6b-46bb-a433-9fbc0f602d12" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.532501] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b48e306-9f6b-46bb-a433-9fbc0f602d12',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.779263] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 388683b1-8e17-479d-9f16-8fe7821a0ef8 in Status: SUCCESS [ 1225.779507] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-388683b1-8e17-479d-9f16-8fe7821a0ef8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.938594] env[70764]: INFO networking_nsxv3.common.synchronization [req-d78522db-3479-4f39-90a1-54affbeba24f req-bf0e0376-3a22-4ed2-8a43-28c4675d1def tempest-InstanceActionsTestJSON-1102661324 tempest-InstanceActionsTestJSON-1102661324-project-member] Enqueued Resource ID: 5c9d913e-edf9-4026-960e-dcebaa4ea777 with Priority: HIGHEST for action security_group_members [ 1225.938875] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c9d913e-edf9-4026-960e-dcebaa4ea777 with Priority: HIGHEST for action security_group_members [ 1225.938982] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c9d913e-edf9-4026-960e-dcebaa4ea777 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.939175] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c9d913e-edf9-4026-960e-dcebaa4ea777" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.939252] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c9d913e-edf9-4026-960e-dcebaa4ea777" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.939505] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c9d913e-edf9-4026-960e-dcebaa4ea777" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.939667] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.939767] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.939832] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.939980] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.940103] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.940196] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c9d913e-edf9-4026-960e-dcebaa4ea777',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.036032] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1b48e306-9f6b-46bb-a433-9fbc0f602d12 with status ACTIVE [ 1226.036032] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.036032] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.036032] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.036032] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.036032] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.036316] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.036357] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.036406] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.037032] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.037032] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.037032] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.037032] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.037032] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.037317] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.037317] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.037317] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1b48e306-9f6b-46bb-a433-9fbc0f602d12 is going to be updated. [ 1226.057805] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.057995] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.057995] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.058245] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.059044] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.059044] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b48e306-9f6b-46bb-a433-9fbc0f602d12" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.209359] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-693 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.209628] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-693" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.209764] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-693" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.210135] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-693" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.210465] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.210641] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.210764] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.211486] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.211486] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.211486] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1226.211691] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1226.211691] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1226.211771] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1226.212107] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1226.212107] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1226.212225] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1226.233036] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1226.233036] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1226.233036] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1226.233240] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-693" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.233563] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-e5d5a20f-bbf7-4f94-8afc-eae9b8fc3cb3 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.233779] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-e5d5a20f-bbf7-4f94-8afc-eae9b8fc3cb3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.233925] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-e5d5a20f-bbf7-4f94-8afc-eae9b8fc3cb3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.234507] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-e5d5a20f-bbf7-4f94-8afc-eae9b8fc3cb3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.234507] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5d5a20f-bbf7-4f94-8afc-eae9b8fc3cb3',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.444226] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.444390] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.444435] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.444627] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.444717] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.444914] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.445024] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.445089] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.445279] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.445347] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.445434] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c9d913e-edf9-4026-960e-dcebaa4ea777 already deleted. [ 1226.445512] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c9d913e-edf9-4026-960e-dcebaa4ea777" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.736330] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.736549] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.736677] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.736948] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.737115] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.737274] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port e5d5a20f-bbf7-4f94-8afc-eae9b8fc3cb3 not found, creating... [ 1226.737564] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.737737] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.737871] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.738099] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.738261] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.738641] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.738917] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.739134] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.739387] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.739554] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.739708] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: e5d5a20f-bbf7-4f94-8afc-eae9b8fc3cb3 is going to be created. [ 1226.757986] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.758189] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.758336] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.758566] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.758789] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.759012] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-e5d5a20f-bbf7-4f94-8afc-eae9b8fc3cb3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.949446] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 in Status: SUCCESS [ 1226.949829] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.949991] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.950248] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.950543] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.950743] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.950853] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.951045] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.951157] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.951292] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.951402] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d148e57-65c0-48a3-9e3c-7f9dc3d97849',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.952265] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.952440] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.952613] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.952720] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.952777] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.953512] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.953512] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.953512] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d148e57-65c0-48a3-9e3c-7f9dc3d97849',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.004744] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12f4761e-3f37-4705-a034-61d725eca2f4 in Status: SUCCESS [ 1227.004931] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12f4761e-3f37-4705-a034-61d725eca2f4 deletion is rescheduled due to dependency. [ 1227.005034] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.005244] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.005448] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.005642] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.005748] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.005816] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.005966] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.006080] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.006190] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.006289] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('12f4761e-3f37-4705-a034-61d725eca2f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.454546] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.454680] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.455468] env[70764]: INFO networking_nsxv3.common.synchronization [req-d78522db-3479-4f39-90a1-54affbeba24f req-fa75e438-bfde-48b3-b4ef-9f5da81ab19c service nova] Enqueued Resource ID: 5c9d913e-edf9-4026-960e-dcebaa4ea777 with Priority: HIGHEST for action security_group_rules [ 1227.455668] env[70764]: INFO networking_nsxv3.common.synchronization [req-d78522db-3479-4f39-90a1-54affbeba24f req-fa75e438-bfde-48b3-b4ef-9f5da81ab19c service nova] Enqueued Resource ID: 5c9d913e-edf9-4026-960e-dcebaa4ea777 with Priority: HIGHEST for action security_group_members [ 1227.455828] env[70764]: INFO networking_nsxv3.common.synchronization [req-d78522db-3479-4f39-90a1-54affbeba24f req-fa75e438-bfde-48b3-b4ef-9f5da81ab19c service nova] Enqueued Resource ID: e5d5a20f-bbf7-4f94-8afc-eae9b8fc3cb3 with Priority: HIGHEST for action port [ 1227.461240] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c9d913e-edf9-4026-960e-dcebaa4ea777 with Priority: HIGHEST for action security_group_rules [ 1227.461240] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c9d913e-edf9-4026-960e-dcebaa4ea777 with Priority: HIGHEST for action security_group_members [ 1227.461240] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5d5a20f-bbf7-4f94-8afc-eae9b8fc3cb3 with Priority: HIGHEST for action port [ 1227.461240] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d148e57-65c0-48a3-9e3c-7f9dc3d97849',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.461240] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c9d913e-edf9-4026-960e-dcebaa4ea777 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.461240] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c9d913e-edf9-4026-960e-dcebaa4ea777" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.461240] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c9d913e-edf9-4026-960e-dcebaa4ea777" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.461240] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c9d913e-edf9-4026-960e-dcebaa4ea777" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.461240] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c9d913e-edf9-4026-960e-dcebaa4ea777',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.461240] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c9d913e-edf9-4026-960e-dcebaa4ea777 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.461240] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c9d913e-edf9-4026-960e-dcebaa4ea777" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.461240] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c9d913e-edf9-4026-960e-dcebaa4ea777" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.461240] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c9d913e-edf9-4026-960e-dcebaa4ea777" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.461694] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.461694] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.461694] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.461694] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.461694] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.461851] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c9d913e-edf9-4026-960e-dcebaa4ea777',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.462654] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5d5a20f-bbf7-4f94-8afc-eae9b8fc3cb3 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.462765] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5d5a20f-bbf7-4f94-8afc-eae9b8fc3cb3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.463429] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5d5a20f-bbf7-4f94-8afc-eae9b8fc3cb3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.463429] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5d5a20f-bbf7-4f94-8afc-eae9b8fc3cb3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.463429] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5d5a20f-bbf7-4f94-8afc-eae9b8fc3cb3',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.508693] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-12f4761e-3f37-4705-a034-61d725eca2f4 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.509105] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.509239] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.509459] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.509637] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.509931] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.510015] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.510182] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.510273] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.510360] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.510517] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-12f4761e-3f37-4705-a034-61d725eca2f4 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.510618] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.510673] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.510815] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.510955] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.511061] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.511119] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.511259] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.511333] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.511635] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.511635] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('12f4761e-3f37-4705-a034-61d725eca2f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.966029] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5c9d913e-edf9-4026-960e-dcebaa4ea777',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.966751] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d148e57-65c0-48a3-9e3c-7f9dc3d97849',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.967532] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e5d5a20f-bbf7-4f94-8afc-eae9b8fc3cb3 with status ACTIVE [ 1227.967749] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.967874] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.967942] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.968159] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.968249] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.968445] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.968546] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.968610] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.968763] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.968972] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.969334] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.969496] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.969606] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.969721] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.969799] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.969890] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e5d5a20f-bbf7-4f94-8afc-eae9b8fc3cb3 is going to be updated. [ 1227.971077] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c9d913e-edf9-4026-960e-dcebaa4ea777 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.971172] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c9d913e-edf9-4026-960e-dcebaa4ea777" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.989290] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.989448] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.989494] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.989667] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.989791] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.989945] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5d5a20f-bbf7-4f94-8afc-eae9b8fc3cb3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.013241] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 12f4761e-3f37-4705-a034-61d725eca2f4: rpc.has_security_group_logging(os_id): False [ 1228.029468] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.029695] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.029774] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.030054] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.030192] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.030474] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.030583] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.030687] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.030856] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.030984] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.031251] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.031383] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.031454] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.031597] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.031675] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.031921] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.032094] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.032167] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.032324] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.032432] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.032535] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12f4761e-3f37-4705-a034-61d725eca2f4 is going to be updated. [ 1228.124841] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.125017] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.125083] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.125333] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.125477] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.142356] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12f4761e-3f37-4705-a034-61d725eca2f4 in Status: IN_PROGRESS for 2s [ 1228.476109] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.476109] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.476109] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.476109] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.476109] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.476109] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 is going to be updated. [ 1228.477388] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5c9d913e-edf9-4026-960e-dcebaa4ea777',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.518138] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.518694] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.518927] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.521100] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.521100] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.530736] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 in Status: IN_PROGRESS for 2s [ 1228.983131] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.983131] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.983131] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.983131] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.983131] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.983131] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c9d913e-edf9-4026-960e-dcebaa4ea777 is going to be created. [ 1229.007631] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.010064] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.010064] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.010064] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.010064] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.017941] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c9d913e-edf9-4026-960e-dcebaa4ea777 in Status: UNINITIALIZED for 2s [ 1230.156609] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12f4761e-3f37-4705-a034-61d725eca2f4 in Status: SUCCESS [ 1230.156970] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.545672] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 in Status: SUCCESS [ 1230.546093] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.546405] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.546862] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.546977] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.548809] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.548809] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.548809] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.548809] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.548809] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.548809] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.548809] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.548809] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.548809] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.548809] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.553546] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.553546] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.553546] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.553546] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.553546] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.553546] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d148e57-65c0-48a3-9e3c-7f9dc3d97849',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.028772] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c9d913e-edf9-4026-960e-dcebaa4ea777 in Status: SUCCESS [ 1231.028988] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c9d913e-edf9-4026-960e-dcebaa4ea777" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.029155] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c9d913e-edf9-4026-960e-dcebaa4ea777" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.029368] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c9d913e-edf9-4026-960e-dcebaa4ea777" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.029562] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.029682] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.029750] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.029906] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.029984] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.030090] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c9d913e-edf9-4026-960e-dcebaa4ea777" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.030180] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5c9d913e-edf9-4026-960e-dcebaa4ea777',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.054310] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d148e57-65c0-48a3-9e3c-7f9dc3d97849: rpc.has_security_group_logging(os_id): False [ 1231.074097] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.074248] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.074310] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.074512] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.074600] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.074798] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.074895] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.074958] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.075121] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.075212] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.075421] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.075519] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.075621] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.075715] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.075788] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.075973] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.076077] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.076139] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.076300] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.076376] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.076464] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 is going to be created. [ 1231.129567] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.129782] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.129863] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.130104] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.130291] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.142942] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 in Status: IN_PROGRESS for 2s [ 1231.532834] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c9d913e-edf9-4026-960e-dcebaa4ea777 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.532834] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c9d913e-edf9-4026-960e-dcebaa4ea777" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.532834] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c9d913e-edf9-4026-960e-dcebaa4ea777" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.533309] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c9d913e-edf9-4026-960e-dcebaa4ea777" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.533309] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.533394] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.533394] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.533546] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.533720] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.533720] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c9d913e-edf9-4026-960e-dcebaa4ea777" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.533896] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c9d913e-edf9-4026-960e-dcebaa4ea777 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.533955] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c9d913e-edf9-4026-960e-dcebaa4ea777" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.534037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c9d913e-edf9-4026-960e-dcebaa4ea777" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.534164] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c9d913e-edf9-4026-960e-dcebaa4ea777" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.534320] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.534394] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.534442] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.534567] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.534642] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.534721] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c9d913e-edf9-4026-960e-dcebaa4ea777" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.534906] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5c9d913e-edf9-4026-960e-dcebaa4ea777',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.037793] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5c9d913e-edf9-4026-960e-dcebaa4ea777: rpc.has_security_group_logging(os_id): False [ 1232.058748] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.058918] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.058959] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.059194] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.059285] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.059481] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.059582] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.059692] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.059806] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.059882] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.060076] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.060164] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.060224] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.060429] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.060504] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.060725] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.060824] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.060884] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.061054] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.061115] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.061202] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c9d913e-edf9-4026-960e-dcebaa4ea777 is going to be created. [ 1232.112825] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.112979] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.113056] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.113253] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.113438] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.123824] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c9d913e-edf9-4026-960e-dcebaa4ea777 in Status: IN_PROGRESS for 2s [ 1232.459971] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1232.459971] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1233.160061] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 in Status: SUCCESS [ 1233.160455] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.160929] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.160929] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.160929] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d148e57-65c0-48a3-9e3c-7f9dc3d97849',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.284424] env[70764]: INFO networking_nsxv3.common.synchronization [None req-eb685104-e741-4174-b3a6-517db866db6d None None] Enqueued Resource ID: 779a0de0-7018-41ff-a9c3-4385d9f2d4a9 with Priority: HIGHEST for action port [ 1233.285452] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 779a0de0-7018-41ff-a9c3-4385d9f2d4a9 with Priority: HIGHEST for action port [ 1233.286591] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-779a0de0-7018-41ff-a9c3-4385d9f2d4a9 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.286796] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-779a0de0-7018-41ff-a9c3-4385d9f2d4a9" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.286871] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-779a0de0-7018-41ff-a9c3-4385d9f2d4a9" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.287146] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-779a0de0-7018-41ff-a9c3-4385d9f2d4a9" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.287576] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('779a0de0-7018-41ff-a9c3-4385d9f2d4a9',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.663636] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.663636] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.663870] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.664429] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.664429] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.664429] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.664595] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.664715] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.664772] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.664852] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.664952] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d148e57-65c0-48a3-9e3c-7f9dc3d97849',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.791797] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 779a0de0-7018-41ff-a9c3-4385d9f2d4a9 [ 1233.792055] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.792251] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.792251] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.792479] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.792610] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.792660] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:779a0de0-7018-41ff-a9c3-4385d9f2d4a9 already deleted. [ 1233.792739] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-779a0de0-7018-41ff-a9c3-4385d9f2d4a9" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.137282] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c9d913e-edf9-4026-960e-dcebaa4ea777 in Status: SUCCESS [ 1234.137282] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c9d913e-edf9-4026-960e-dcebaa4ea777" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.169048] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.169048] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.169048] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.169048] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.169870] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.169870] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.170029] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.170262] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.170370] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.170911] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.170911] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.170911] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.170911] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.171111] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.171183] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.171272] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.171336] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.171477] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.171553] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.171636] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.171724] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d148e57-65c0-48a3-9e3c-7f9dc3d97849',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.673656] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d148e57-65c0-48a3-9e3c-7f9dc3d97849: rpc.has_security_group_logging(os_id): False [ 1234.691262] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.691480] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.691589] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.692023] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.692122] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.692388] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.692550] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.692654] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.692880] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.692995] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.693288] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.693437] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.693544] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.693750] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.694054] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.694227] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.694388] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.694498] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.694702] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.694815] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.694959] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 is going to be updated. [ 1234.753895] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.754101] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.754152] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.754341] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.754491] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.774630] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 in Status: IN_PROGRESS for 2s [ 1235.311351] env[70764]: INFO networking_nsxv3.common.synchronization [None req-d27b17f1-0c4f-4ef9-90cb-2b2535c87c54 None None] Enqueued Resource ID: 22def64e-fc29-411d-bc9d-4acd3f12d1b9 with Priority: HIGHEST for action port [ 1235.311351] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22def64e-fc29-411d-bc9d-4acd3f12d1b9 with Priority: HIGHEST for action port [ 1235.312259] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-22def64e-fc29-411d-bc9d-4acd3f12d1b9 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.312614] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-22def64e-fc29-411d-bc9d-4acd3f12d1b9" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.312840] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-22def64e-fc29-411d-bc9d-4acd3f12d1b9" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.313300] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-22def64e-fc29-411d-bc9d-4acd3f12d1b9" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.313656] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22def64e-fc29-411d-bc9d-4acd3f12d1b9',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.816595] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 22def64e-fc29-411d-bc9d-4acd3f12d1b9 [ 1235.816863] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.817033] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.817130] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.817360] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.817507] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.817555] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:22def64e-fc29-411d-bc9d-4acd3f12d1b9 already deleted. [ 1235.817638] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-22def64e-fc29-411d-bc9d-4acd3f12d1b9" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.071923] env[70764]: INFO networking_nsxv3.common.synchronization [req-781aa329-e326-42b0-99b8-e91a7745720a req-6a2f9129-783b-40c8-9d2c-b1cbeca91cbb tempest-ServersTestMultiNic-1176763844 tempest-ServersTestMultiNic-1176763844-project-member] Enqueued Resource ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 with Priority: HIGHEST for action security_group_members [ 1236.072667] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 with Priority: HIGHEST for action security_group_members [ 1236.072787] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.072910] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.072979] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.073208] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.073380] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.073487] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.073550] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.073704] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.073786] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.073881] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d148e57-65c0-48a3-9e3c-7f9dc3d97849',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.228825] env[70764]: INFO networking_nsxv3.common.synchronization [req-781aa329-e326-42b0-99b8-e91a7745720a req-72256c20-5f76-4ab2-9814-6ca7eef9eced tempest-ServersTestMultiNic-1176763844 tempest-ServersTestMultiNic-1176763844-project-member] Enqueued Resource ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 with Priority: HIGHEST for action security_group_members [ 1236.229402] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 with Priority: HIGHEST for action security_group_members [ 1236.229713] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.229817] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.576440] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d148e57-65c0-48a3-9e3c-7f9dc3d97849',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.789619] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 in Status: SUCCESS [ 1236.789857] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.078635] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d148e57-65c0-48a3-9e3c-7f9dc3d97849',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.580977] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.581333] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.581333] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.581513] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.581631] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.581750] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 is going to be updated. [ 1237.610196] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.610381] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.610471] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.610642] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.610782] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.618067] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 in Status: IN_PROGRESS for 2s [ 1238.773590] env[70764]: INFO networking_nsxv3.common.synchronization [req-0b3e5f6a-9167-40fc-b76b-84afe33b4c87 req-bb860fb4-9dd1-47be-a7a2-a8d779e534c7 tempest-ServerRescueTestJSONUnderV235-1098315367 tempest-ServerRescueTestJSONUnderV235-1098315367-project-member] Enqueued Resource ID: 14c59290-935a-4874-a961-0e5bb884ebb5 with Priority: HIGHEST for action security_group_members [ 1238.773927] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14c59290-935a-4874-a961-0e5bb884ebb5 with Priority: HIGHEST for action security_group_members [ 1238.774242] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-14c59290-935a-4874-a961-0e5bb884ebb5 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.774366] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.774433] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.774685] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.774837] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.774934] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.774992] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.775323] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.775418] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.775500] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14c59290-935a-4874-a961-0e5bb884ebb5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.036854] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-670 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.037069] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-670" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.037552] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-670" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.037552] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-670" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.037784] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.037961] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.038835] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.038835] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.038835] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.038835] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1239.038835] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1239.038835] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1239.039053] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1239.039053] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1239.039163] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1239.039298] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1239.058271] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1239.058441] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1239.058582] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1239.058759] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-670" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.059078] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-4fc8ed0b-82c8-406a-acd1-f3857c2484da taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.059255] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-4fc8ed0b-82c8-406a-acd1-f3857c2484da" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.059379] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-4fc8ed0b-82c8-406a-acd1-f3857c2484da" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.059689] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-4fc8ed0b-82c8-406a-acd1-f3857c2484da" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.059832] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4fc8ed0b-82c8-406a-acd1-f3857c2484da',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.277343] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.277559] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.277604] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.277824] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.277920] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.278139] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.278244] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.278306] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.278460] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.278536] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.278623] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14c59290-935a-4874-a961-0e5bb884ebb5 already deleted. [ 1239.278703] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.562821] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.563095] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.563245] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.563626] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.563807] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.563981] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 4fc8ed0b-82c8-406a-acd1-f3857c2484da not found, creating... [ 1239.564271] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.564448] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.564583] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.564827] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.564978] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.565353] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.565523] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.565656] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.565886] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.566045] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.566213] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 4fc8ed0b-82c8-406a-acd1-f3857c2484da is going to be created. [ 1239.585712] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.585939] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.586131] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.586322] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.586602] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.586848] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-4fc8ed0b-82c8-406a-acd1-f3857c2484da" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.626429] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 in Status: SUCCESS [ 1239.626629] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.626785] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.626991] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.627190] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.627312] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.627382] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.627533] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.627632] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.627737] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d148e57-65c0-48a3-9e3c-7f9dc3d97849',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.130311] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.130602] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.130602] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.130766] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.130860] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.131077] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.131178] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.131240] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.131410] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.131477] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.131564] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 is going to be updated. [ 1240.155938] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.156207] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.156296] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.156526] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.156663] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.164312] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 in Status: IN_PROGRESS for 2s [ 1240.273493] env[70764]: INFO networking_nsxv3.common.synchronization [req-0b3e5f6a-9167-40fc-b76b-84afe33b4c87 req-7eb494a9-c8fd-48bd-acdd-0ee2c003762f service nova] Enqueued Resource ID: 14c59290-935a-4874-a961-0e5bb884ebb5 with Priority: HIGHEST for action security_group_rules [ 1240.273673] env[70764]: INFO networking_nsxv3.common.synchronization [req-0b3e5f6a-9167-40fc-b76b-84afe33b4c87 req-7eb494a9-c8fd-48bd-acdd-0ee2c003762f service nova] Enqueued Resource ID: 14c59290-935a-4874-a961-0e5bb884ebb5 with Priority: HIGHEST for action security_group_members [ 1240.273814] env[70764]: INFO networking_nsxv3.common.synchronization [req-0b3e5f6a-9167-40fc-b76b-84afe33b4c87 req-7eb494a9-c8fd-48bd-acdd-0ee2c003762f service nova] Enqueued Resource ID: 4fc8ed0b-82c8-406a-acd1-f3857c2484da with Priority: HIGHEST for action port [ 1240.274069] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14c59290-935a-4874-a961-0e5bb884ebb5 with Priority: HIGHEST for action security_group_rules [ 1240.274202] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14c59290-935a-4874-a961-0e5bb884ebb5 with Priority: HIGHEST for action security_group_members [ 1240.274299] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fc8ed0b-82c8-406a-acd1-f3857c2484da with Priority: HIGHEST for action port [ 1240.274848] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14c59290-935a-4874-a961-0e5bb884ebb5 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.274978] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.275178] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.275547] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.275625] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14c59290-935a-4874-a961-0e5bb884ebb5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.277246] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-14c59290-935a-4874-a961-0e5bb884ebb5 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.277694] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.277799] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.277999] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.278198] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.278362] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.278465] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.278654] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.278764] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.278878] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14c59290-935a-4874-a961-0e5bb884ebb5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.282490] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-4fc8ed0b-82c8-406a-acd1-f3857c2484da taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.282490] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4fc8ed0b-82c8-406a-acd1-f3857c2484da" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.282490] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4fc8ed0b-82c8-406a-acd1-f3857c2484da" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.282490] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4fc8ed0b-82c8-406a-acd1-f3857c2484da" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.282490] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4fc8ed0b-82c8-406a-acd1-f3857c2484da',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.782228] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-14c59290-935a-4874-a961-0e5bb884ebb5 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.782377] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.782603] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4fc8ed0b-82c8-406a-acd1-f3857c2484da with status ACTIVE [ 1240.782719] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.782818] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.782948] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.783187] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.783323] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.783516] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.783597] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.784040] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.784205] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.784293] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.784483] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.784595] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.784655] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.784804] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.784888] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.784974] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4fc8ed0b-82c8-406a-acd1-f3857c2484da is going to be updated. [ 1240.786107] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('14c59290-935a-4874-a961-0e5bb884ebb5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.804694] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.804840] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.804911] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.805147] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.805281] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.805471] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4fc8ed0b-82c8-406a-acd1-f3857c2484da" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.288920] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('14c59290-935a-4874-a961-0e5bb884ebb5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.790939] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.791224] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.791381] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.791604] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.791704] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.791822] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14c59290-935a-4874-a961-0e5bb884ebb5 is going to be created. [ 1241.821345] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.821533] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.821533] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.821773] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.821952] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.830573] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14c59290-935a-4874-a961-0e5bb884ebb5 in Status: UNINITIALIZED for 2s [ 1242.173418] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 in Status: SUCCESS [ 1242.173582] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d148e57-65c0-48a3-9e3c-7f9dc3d97849 deletion is rescheduled due to dependency. [ 1242.173691] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d148e57-65c0-48a3-9e3c-7f9dc3d97849" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.839980] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14c59290-935a-4874-a961-0e5bb884ebb5 in Status: SUCCESS [ 1243.840274] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.840368] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.840580] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.840775] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.840892] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.840959] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.841121] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.841202] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.841297] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.841387] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('14c59290-935a-4874-a961-0e5bb884ebb5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.343634] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-14c59290-935a-4874-a961-0e5bb884ebb5 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.343859] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.343859] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.344145] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.344325] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.344454] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.344499] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.344663] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.344792] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.344886] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.345061] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-14c59290-935a-4874-a961-0e5bb884ebb5 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.345165] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.345226] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.345823] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.345823] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.345823] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.345823] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.346081] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.346081] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.346081] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.346175] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('14c59290-935a-4874-a961-0e5bb884ebb5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.618787] env[70764]: INFO networking_nsxv3.common.synchronization [req-577a4255-b70d-4ed0-87ba-63fa80077b70 req-66c6666a-0de7-464a-8c0c-4b5f275c29ee tempest-InstanceActionsTestJSON-1102661324 tempest-InstanceActionsTestJSON-1102661324-project-member] Enqueued Resource ID: 5c9d913e-edf9-4026-960e-dcebaa4ea777 with Priority: HIGHEST for action security_group_members [ 1244.618938] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c9d913e-edf9-4026-960e-dcebaa4ea777 with Priority: HIGHEST for action security_group_members [ 1244.619420] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c9d913e-edf9-4026-960e-dcebaa4ea777 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.619637] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c9d913e-edf9-4026-960e-dcebaa4ea777" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.619721] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c9d913e-edf9-4026-960e-dcebaa4ea777" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.619973] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c9d913e-edf9-4026-960e-dcebaa4ea777" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.620215] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.620305] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.620424] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.620621] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.620621] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.621512] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c9d913e-edf9-4026-960e-dcebaa4ea777',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.849418] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 14c59290-935a-4874-a961-0e5bb884ebb5: rpc.has_security_group_logging(os_id): False [ 1244.865894] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.866058] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.866110] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.866303] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.866392] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.866580] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.866682] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.866744] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.866887] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.866964] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.867156] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.867267] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.867306] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.867442] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.867514] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.867700] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.867793] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.867853] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.867986] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.868074] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.868158] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14c59290-935a-4874-a961-0e5bb884ebb5 is going to be created. [ 1244.931927] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.932111] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.932162] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.932310] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.932487] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.942098] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14c59290-935a-4874-a961-0e5bb884ebb5 in Status: IN_PROGRESS for 2s [ 1245.123797] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.123968] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.124043] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.124272] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.124362] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.124585] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.124683] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.124758] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.124909] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.124996] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.125099] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c9d913e-edf9-4026-960e-dcebaa4ea777 is going to be updated. [ 1245.150907] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.151067] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.151114] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.151285] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.151420] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.159063] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c9d913e-edf9-4026-960e-dcebaa4ea777 in Status: IN_PROGRESS for 2s [ 1246.953031] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14c59290-935a-4874-a961-0e5bb884ebb5 in Status: SUCCESS [ 1246.953478] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.177018] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c9d913e-edf9-4026-960e-dcebaa4ea777 in Status: SUCCESS [ 1247.177235] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c9d913e-edf9-4026-960e-dcebaa4ea777 deletion is rescheduled due to dependency. [ 1247.177370] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c9d913e-edf9-4026-960e-dcebaa4ea777" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.620391] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1249.621297] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1254.622751] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1254.622751] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1254.721036] env[70764]: INFO networking_nsxv3.common.synchronization [req-8a13b947-a658-4f8f-a5cc-35718a0d4b96 req-4b94de7a-d785-4cdd-8ba1-7c8cc63622d0 tempest-ServerActionsTestOtherA-1368461845 tempest-ServerActionsTestOtherA-1368461845-project-member] Enqueued Resource ID: 9325a264-8c44-482f-92be-005801a22ea6 with Priority: HIGHEST for action security_group_members [ 1254.721036] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9325a264-8c44-482f-92be-005801a22ea6 with Priority: HIGHEST for action security_group_members [ 1254.721458] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9325a264-8c44-482f-92be-005801a22ea6 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.721571] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.721640] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.721889] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.722066] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.722167] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.722249] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.722406] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.722509] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.722589] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9325a264-8c44-482f-92be-005801a22ea6',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.985109] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-388 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.985334] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-388" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.985478] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-388" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.985770] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-388" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.986050] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.986213] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.986332] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.986546] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.986706] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.986919] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1254.987045] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1254.987156] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1254.987265] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1254.987376] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1254.987482] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1254.987619] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1255.010571] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1255.010723] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1255.010863] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1255.011050] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-388" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.011339] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-8cbaa9ca-60af-4cb6-8a3a-1b81386c5dd7 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.011505] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-8cbaa9ca-60af-4cb6-8a3a-1b81386c5dd7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.011649] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-8cbaa9ca-60af-4cb6-8a3a-1b81386c5dd7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.012007] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-8cbaa9ca-60af-4cb6-8a3a-1b81386c5dd7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.012165] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8cbaa9ca-60af-4cb6-8a3a-1b81386c5dd7',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.224764] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.224897] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.224941] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.225167] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.225267] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.225511] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.225630] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.225696] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.225871] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.225950] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.226061] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9325a264-8c44-482f-92be-005801a22ea6 already deleted. [ 1255.226142] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.516388] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.516388] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.516388] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.516388] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.516388] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.516388] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 8cbaa9ca-60af-4cb6-8a3a-1b81386c5dd7 not found, creating... [ 1255.516388] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.516388] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.516388] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.516388] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.516388] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.516968] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.516968] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.516968] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.517318] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.517983] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.517983] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 8cbaa9ca-60af-4cb6-8a3a-1b81386c5dd7 is going to be created. [ 1255.538349] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.538557] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.538679] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.538932] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.539182] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.539409] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-8cbaa9ca-60af-4cb6-8a3a-1b81386c5dd7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.235398] env[70764]: INFO networking_nsxv3.common.synchronization [req-8a13b947-a658-4f8f-a5cc-35718a0d4b96 req-758e4ff5-cb25-488b-8061-be2f7b1ed530 service nova] Enqueued Resource ID: 9325a264-8c44-482f-92be-005801a22ea6 with Priority: HIGHEST for action security_group_rules [ 1256.235774] env[70764]: INFO networking_nsxv3.common.synchronization [req-8a13b947-a658-4f8f-a5cc-35718a0d4b96 req-758e4ff5-cb25-488b-8061-be2f7b1ed530 service nova] Enqueued Resource ID: 9325a264-8c44-482f-92be-005801a22ea6 with Priority: HIGHEST for action security_group_members [ 1256.235774] env[70764]: INFO networking_nsxv3.common.synchronization [req-8a13b947-a658-4f8f-a5cc-35718a0d4b96 req-758e4ff5-cb25-488b-8061-be2f7b1ed530 service nova] Enqueued Resource ID: 8cbaa9ca-60af-4cb6-8a3a-1b81386c5dd7 with Priority: HIGHEST for action port [ 1256.235977] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9325a264-8c44-482f-92be-005801a22ea6 with Priority: HIGHEST for action security_group_rules [ 1256.236118] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9325a264-8c44-482f-92be-005801a22ea6 with Priority: HIGHEST for action security_group_members [ 1256.236215] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8cbaa9ca-60af-4cb6-8a3a-1b81386c5dd7 with Priority: HIGHEST for action port [ 1256.236755] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9325a264-8c44-482f-92be-005801a22ea6 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.236905] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.236980] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.237263] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.237349] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9325a264-8c44-482f-92be-005801a22ea6',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.238202] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9325a264-8c44-482f-92be-005801a22ea6 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.238326] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.238398] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.238561] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.238709] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.238802] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.238864] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.239072] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.239164] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.239323] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9325a264-8c44-482f-92be-005801a22ea6',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.239963] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-8cbaa9ca-60af-4cb6-8a3a-1b81386c5dd7 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.240085] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8cbaa9ca-60af-4cb6-8a3a-1b81386c5dd7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.240150] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8cbaa9ca-60af-4cb6-8a3a-1b81386c5dd7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.240297] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8cbaa9ca-60af-4cb6-8a3a-1b81386c5dd7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.240371] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8cbaa9ca-60af-4cb6-8a3a-1b81386c5dd7',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.742528] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9325a264-8c44-482f-92be-005801a22ea6 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.742713] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.742895] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9325a264-8c44-482f-92be-005801a22ea6',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.743829] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8cbaa9ca-60af-4cb6-8a3a-1b81386c5dd7 with status ACTIVE [ 1256.747049] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.747049] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.747049] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.747049] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.747049] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.747049] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.747049] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.747049] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.747049] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.747049] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.747049] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.747049] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.747049] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.747049] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.747049] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.747049] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8cbaa9ca-60af-4cb6-8a3a-1b81386c5dd7 is going to be updated. [ 1256.770266] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.770454] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.770503] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.770740] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.770965] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.771234] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8cbaa9ca-60af-4cb6-8a3a-1b81386c5dd7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.782713] env[70764]: INFO networking_nsxv3.common.synchronization [req-bdd906af-d2d5-459b-b108-376afc05cdeb req-a7f0ee79-b9b3-40d3-a683-8d936a668d58 tempest-ServerRescueTestJSONUnderV235-1098315367 tempest-ServerRescueTestJSONUnderV235-1098315367-project-member] Enqueued Resource ID: 14c59290-935a-4874-a961-0e5bb884ebb5 with Priority: HIGHEST for action security_group_members [ 1256.782901] env[70764]: INFO networking_nsxv3.common.synchronization [req-bdd906af-d2d5-459b-b108-376afc05cdeb req-a7f0ee79-b9b3-40d3-a683-8d936a668d58 tempest-ServerRescueTestJSONUnderV235-1098315367 tempest-ServerRescueTestJSONUnderV235-1098315367-project-member] Enqueued Resource ID: 30537957-1e35-4ca9-91d5-e2e0492569bd with Priority: HIGHEST for action security_group_members [ 1256.783401] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14c59290-935a-4874-a961-0e5bb884ebb5 with Priority: HIGHEST for action security_group_members [ 1256.783587] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30537957-1e35-4ca9-91d5-e2e0492569bd with Priority: HIGHEST for action security_group_members [ 1256.783879] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-14c59290-935a-4874-a961-0e5bb884ebb5 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.783999] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.784080] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.784264] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.784414] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.784514] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.784576] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.784767] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.784803] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.784876] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14c59290-935a-4874-a961-0e5bb884ebb5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.785786] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-30537957-1e35-4ca9-91d5-e2e0492569bd taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.785933] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30537957-1e35-4ca9-91d5-e2e0492569bd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.786039] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30537957-1e35-4ca9-91d5-e2e0492569bd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.786433] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30537957-1e35-4ca9-91d5-e2e0492569bd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.786433] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.786571] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.786604] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.786740] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.786835] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.786922] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30537957-1e35-4ca9-91d5-e2e0492569bd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.824145] env[70764]: INFO networking_nsxv3.common.synchronization [req-bdd906af-d2d5-459b-b108-376afc05cdeb req-a7f0ee79-b9b3-40d3-a683-8d936a668d58 tempest-ServerRescueTestJSONUnderV235-1098315367 tempest-ServerRescueTestJSONUnderV235-1098315367-project-member] Enqueued Resource ID: 14c59290-935a-4874-a961-0e5bb884ebb5 with Priority: HIGHEST for action security_group_rules [ 1256.824306] env[70764]: INFO networking_nsxv3.common.synchronization [req-bdd906af-d2d5-459b-b108-376afc05cdeb req-a7f0ee79-b9b3-40d3-a683-8d936a668d58 tempest-ServerRescueTestJSONUnderV235-1098315367 tempest-ServerRescueTestJSONUnderV235-1098315367-project-member] Enqueued Resource ID: 14c59290-935a-4874-a961-0e5bb884ebb5 with Priority: HIGHEST for action security_group_members [ 1256.824448] env[70764]: INFO networking_nsxv3.common.synchronization [req-bdd906af-d2d5-459b-b108-376afc05cdeb req-a7f0ee79-b9b3-40d3-a683-8d936a668d58 tempest-ServerRescueTestJSONUnderV235-1098315367 tempest-ServerRescueTestJSONUnderV235-1098315367-project-member] Enqueued Resource ID: 30537957-1e35-4ca9-91d5-e2e0492569bd with Priority: HIGHEST for action security_group_rules [ 1256.824582] env[70764]: INFO networking_nsxv3.common.synchronization [req-bdd906af-d2d5-459b-b108-376afc05cdeb req-a7f0ee79-b9b3-40d3-a683-8d936a668d58 tempest-ServerRescueTestJSONUnderV235-1098315367 tempest-ServerRescueTestJSONUnderV235-1098315367-project-member] Enqueued Resource ID: 30537957-1e35-4ca9-91d5-e2e0492569bd with Priority: HIGHEST for action security_group_members [ 1256.824737] env[70764]: INFO networking_nsxv3.common.synchronization [req-bdd906af-d2d5-459b-b108-376afc05cdeb req-a7f0ee79-b9b3-40d3-a683-8d936a668d58 tempest-ServerRescueTestJSONUnderV235-1098315367 tempest-ServerRescueTestJSONUnderV235-1098315367-project-member] Enqueued Resource ID: 4fc8ed0b-82c8-406a-acd1-f3857c2484da with Priority: HIGHEST for action port [ 1256.824981] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14c59290-935a-4874-a961-0e5bb884ebb5 with Priority: HIGHEST for action security_group_rules [ 1256.825118] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30537957-1e35-4ca9-91d5-e2e0492569bd with Priority: HIGHEST for action security_group_rules [ 1256.825216] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fc8ed0b-82c8-406a-acd1-f3857c2484da with Priority: HIGHEST for action port [ 1256.825305] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14c59290-935a-4874-a961-0e5bb884ebb5 with Priority: HIGHEST for action security_group_members [ 1256.825402] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30537957-1e35-4ca9-91d5-e2e0492569bd with Priority: HIGHEST for action security_group_members [ 1256.826445] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14c59290-935a-4874-a961-0e5bb884ebb5 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.826717] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.827604] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.827604] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.827604] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14c59290-935a-4874-a961-0e5bb884ebb5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.828256] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30537957-1e35-4ca9-91d5-e2e0492569bd taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.828364] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30537957-1e35-4ca9-91d5-e2e0492569bd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.828408] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30537957-1e35-4ca9-91d5-e2e0492569bd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.828660] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30537957-1e35-4ca9-91d5-e2e0492569bd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.828763] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30537957-1e35-4ca9-91d5-e2e0492569bd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.829916] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-4fc8ed0b-82c8-406a-acd1-f3857c2484da taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.830119] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4fc8ed0b-82c8-406a-acd1-f3857c2484da" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.830221] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4fc8ed0b-82c8-406a-acd1-f3857c2484da" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.830425] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4fc8ed0b-82c8-406a-acd1-f3857c2484da" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.830702] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4fc8ed0b-82c8-406a-acd1-f3857c2484da',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.832036] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-14c59290-935a-4874-a961-0e5bb884ebb5 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.832142] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.832337] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-30537957-1e35-4ca9-91d5-e2e0492569bd taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.832475] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30537957-1e35-4ca9-91d5-e2e0492569bd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.107726] env[70764]: INFO networking_nsxv3.common.synchronization [req-7ebae7be-f661-46e3-bc15-c5f66cdb0d2e req-7f910069-799a-4f19-8ba2-b98b6ef42bf2 tempest-ServerRescueTestJSONUnderV235-1098315367 tempest-ServerRescueTestJSONUnderV235-1098315367-project-member] Enqueued Resource ID: 14c59290-935a-4874-a961-0e5bb884ebb5 with Priority: HIGHEST for action security_group_members [ 1257.107914] env[70764]: INFO networking_nsxv3.common.synchronization [req-7ebae7be-f661-46e3-bc15-c5f66cdb0d2e req-7f910069-799a-4f19-8ba2-b98b6ef42bf2 tempest-ServerRescueTestJSONUnderV235-1098315367 tempest-ServerRescueTestJSONUnderV235-1098315367-project-member] Enqueued Resource ID: 30537957-1e35-4ca9-91d5-e2e0492569bd with Priority: HIGHEST for action security_group_members [ 1257.108650] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14c59290-935a-4874-a961-0e5bb884ebb5 with Priority: HIGHEST for action security_group_members [ 1257.108791] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30537957-1e35-4ca9-91d5-e2e0492569bd with Priority: HIGHEST for action security_group_members [ 1257.109168] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-14c59290-935a-4874-a961-0e5bb884ebb5 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.109281] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.109501] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-30537957-1e35-4ca9-91d5-e2e0492569bd taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.109592] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30537957-1e35-4ca9-91d5-e2e0492569bd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.150020] env[70764]: INFO networking_nsxv3.common.synchronization [req-7ebae7be-f661-46e3-bc15-c5f66cdb0d2e req-7f910069-799a-4f19-8ba2-b98b6ef42bf2 tempest-ServerRescueTestJSONUnderV235-1098315367 tempest-ServerRescueTestJSONUnderV235-1098315367-project-member] Enqueued Resource ID: 14c59290-935a-4874-a961-0e5bb884ebb5 with Priority: HIGHEST for action security_group_rules [ 1257.150235] env[70764]: INFO networking_nsxv3.common.synchronization [req-7ebae7be-f661-46e3-bc15-c5f66cdb0d2e req-7f910069-799a-4f19-8ba2-b98b6ef42bf2 tempest-ServerRescueTestJSONUnderV235-1098315367 tempest-ServerRescueTestJSONUnderV235-1098315367-project-member] Enqueued Resource ID: 14c59290-935a-4874-a961-0e5bb884ebb5 with Priority: HIGHEST for action security_group_members [ 1257.150354] env[70764]: INFO networking_nsxv3.common.synchronization [req-7ebae7be-f661-46e3-bc15-c5f66cdb0d2e req-7f910069-799a-4f19-8ba2-b98b6ef42bf2 tempest-ServerRescueTestJSONUnderV235-1098315367 tempest-ServerRescueTestJSONUnderV235-1098315367-project-member] Enqueued Resource ID: 4fc8ed0b-82c8-406a-acd1-f3857c2484da with Priority: HIGHEST for action port [ 1257.150574] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14c59290-935a-4874-a961-0e5bb884ebb5 with Priority: HIGHEST for action security_group_rules [ 1257.150696] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14c59290-935a-4874-a961-0e5bb884ebb5 with Priority: HIGHEST for action security_group_members [ 1257.150788] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fc8ed0b-82c8-406a-acd1-f3857c2484da with Priority: HIGHEST for action port [ 1257.151306] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14c59290-935a-4874-a961-0e5bb884ebb5 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.151410] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.151617] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-14c59290-935a-4874-a961-0e5bb884ebb5 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.151702] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.151903] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-4fc8ed0b-82c8-406a-acd1-f3857c2484da taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.151947] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4fc8ed0b-82c8-406a-acd1-f3857c2484da" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.249620] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9325a264-8c44-482f-92be-005801a22ea6',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.294139] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('14c59290-935a-4874-a961-0e5bb884ebb5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.294139] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30537957-1e35-4ca9-91d5-e2e0492569bd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.333626] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-30537957-1e35-4ca9-91d5-e2e0492569bd taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.333735] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30537957-1e35-4ca9-91d5-e2e0492569bd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.334065] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4fc8ed0b-82c8-406a-acd1-f3857c2484da with status ACTIVE [ 1257.334255] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.334373] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.334442] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.334653] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.334751] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.334935] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.335121] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.335121] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.335235] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.335309] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.335583] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.335759] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.335834] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.336075] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.336170] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.336267] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4fc8ed0b-82c8-406a-acd1-f3857c2484da is going to be updated. [ 1257.337408] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-14c59290-935a-4874-a961-0e5bb884ebb5 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.337507] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.358811] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.358975] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.359080] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.359304] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.359468] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.359659] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4fc8ed0b-82c8-406a-acd1-f3857c2484da" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.359831] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4fc8ed0b-82c8-406a-acd1-f3857c2484da" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.360086] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4fc8ed0b-82c8-406a-acd1-f3857c2484da" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.360188] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4fc8ed0b-82c8-406a-acd1-f3857c2484da',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.752422] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.752584] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.752654] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.752876] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.752965] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.753081] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9325a264-8c44-482f-92be-005801a22ea6 is going to be created. [ 1257.777506] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.777679] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.777727] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.777933] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.778116] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.786759] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9325a264-8c44-482f-92be-005801a22ea6 in Status: UNINITIALIZED for 2s [ 1257.801059] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('14c59290-935a-4874-a961-0e5bb884ebb5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.801059] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30537957-1e35-4ca9-91d5-e2e0492569bd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.865832] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4fc8ed0b-82c8-406a-acd1-f3857c2484da with status ACTIVE [ 1257.866070] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.866215] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.866285] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.866494] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.866634] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.866854] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.866963] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.867038] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.867197] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.867277] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.867459] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.867548] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.867611] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.867753] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.867827] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.867912] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4fc8ed0b-82c8-406a-acd1-f3857c2484da is going to be updated. [ 1257.886904] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.887023] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.887094] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.887258] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.887382] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.887526] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4fc8ed0b-82c8-406a-acd1-f3857c2484da" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.305430] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.305834] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.305834] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.305969] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.306039] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.306157] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14c59290-935a-4874-a961-0e5bb884ebb5 is going to be updated. [ 1258.307436] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.307564] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.307636] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.307807] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.307891] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.307970] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30537957-1e35-4ca9-91d5-e2e0492569bd is going to be created. [ 1258.332975] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.333225] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.333225] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.333404] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.333555] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.336857] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.336981] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.337068] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.337224] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.337353] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.343374] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30537957-1e35-4ca9-91d5-e2e0492569bd in Status: UNINITIALIZED for 2s [ 1258.344512] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14c59290-935a-4874-a961-0e5bb884ebb5 in Status: IN_PROGRESS for 2s [ 1259.795892] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9325a264-8c44-482f-92be-005801a22ea6 in Status: SUCCESS [ 1259.796231] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.796286] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.796588] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.796826] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.796995] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.797102] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.797290] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.797396] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.797507] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.797624] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9325a264-8c44-482f-92be-005801a22ea6',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.299650] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9325a264-8c44-482f-92be-005801a22ea6 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.299818] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.299894] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.300132] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.300298] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.300394] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.300460] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.300616] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.300743] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.300782] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.300970] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9325a264-8c44-482f-92be-005801a22ea6 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.301047] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.301472] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.301472] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.301472] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.301472] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.301663] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.301663] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.301729] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.301801] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.302055] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9325a264-8c44-482f-92be-005801a22ea6',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.353828] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14c59290-935a-4874-a961-0e5bb884ebb5 in Status: SUCCESS [ 1260.354047] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.354206] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.354407] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.354580] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.354695] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.354761] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.354907] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.354988] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.355090] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14c59290-935a-4874-a961-0e5bb884ebb5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.356402] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30537957-1e35-4ca9-91d5-e2e0492569bd in Status: SUCCESS [ 1260.356601] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30537957-1e35-4ca9-91d5-e2e0492569bd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.356744] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30537957-1e35-4ca9-91d5-e2e0492569bd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.356904] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30537957-1e35-4ca9-91d5-e2e0492569bd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.357081] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.357185] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.357249] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.357410] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.357450] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.357539] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30537957-1e35-4ca9-91d5-e2e0492569bd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.428040] env[70764]: INFO networking_nsxv3.common.synchronization [req-25b4beaf-ad17-4748-9d77-10ccf5b2cd22 req-d92691e4-720c-47dc-a151-d2f96b601200 tempest-ServerActionsTestOtherB-1188510512 tempest-ServerActionsTestOtherB-1188510512-project-member] Enqueued Resource ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b with Priority: HIGHEST for action security_group_members [ 1260.428549] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b with Priority: HIGHEST for action security_group_members [ 1260.428865] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.428998] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.429101] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.429237] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.429393] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.429496] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.429568] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.429712] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.429808] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.429898] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.807439] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9325a264-8c44-482f-92be-005801a22ea6: rpc.has_security_group_logging(os_id): False [ 1260.824505] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.824755] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.824755] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.825094] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.825094] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.825353] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.825555] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.825555] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.825721] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.825801] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.825995] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.826129] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.826195] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.826316] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.826390] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.826572] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.826676] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.826730] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.826848] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.826918] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.827008] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9325a264-8c44-482f-92be-005801a22ea6 is going to be created. [ 1260.859451] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('14c59290-935a-4874-a961-0e5bb884ebb5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.860688] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.860921] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.860921] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.861229] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.861331] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.861538] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.861667] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.861746] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.862052] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.862150] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.862249] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30537957-1e35-4ca9-91d5-e2e0492569bd is going to be deleted. [ 1260.882417] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.882574] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.882647] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.882856] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.883056] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.893164] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.893320] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.893374] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.893561] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.893705] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.893756] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30537957-1e35-4ca9-91d5-e2e0492569bd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.893883] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30537957-1e35-4ca9-91d5-e2e0492569bd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.894045] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30537957-1e35-4ca9-91d5-e2e0492569bd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.894215] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.894312] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.894375] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.894511] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.894587] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.894680] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30537957-1e35-4ca9-91d5-e2e0492569bd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.896355] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9325a264-8c44-482f-92be-005801a22ea6 in Status: IN_PROGRESS for 2s [ 1260.933109] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.933321] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.933368] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.933671] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.933754] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.933951] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.934073] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.934148] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.934289] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.934384] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.934474] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b is going to be updated. [ 1260.974494] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.974704] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.974752] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.974946] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.975110] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.984444] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b in Status: IN_PROGRESS for 2s [ 1261.364719] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('14c59290-935a-4874-a961-0e5bb884ebb5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.398061] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.398246] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.398320] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.398521] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.398617] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.398819] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.398920] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.398985] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.399146] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.399226] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.399310] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30537957-1e35-4ca9-91d5-e2e0492569bd already deleted. [ 1261.399387] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30537957-1e35-4ca9-91d5-e2e0492569bd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.399533] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30537957-1e35-4ca9-91d5-e2e0492569bd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.399679] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30537957-1e35-4ca9-91d5-e2e0492569bd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.399822] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.399915] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.399975] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.400119] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.400191] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.400282] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30537957-1e35-4ca9-91d5-e2e0492569bd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.868086] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.868086] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.868086] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.868086] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.868086] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.868641] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14c59290-935a-4874-a961-0e5bb884ebb5 is going to be updated. [ 1261.895927] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.896116] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.896190] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.896418] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.896590] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.903236] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.903363] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.903424] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.903604] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.903709] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.903894] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.903984] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.904073] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.904219] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.904292] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.904394] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30537957-1e35-4ca9-91d5-e2e0492569bd already deleted. [ 1261.904474] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30537957-1e35-4ca9-91d5-e2e0492569bd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.904564] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('30537957-1e35-4ca9-91d5-e2e0492569bd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.905946] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14c59290-935a-4874-a961-0e5bb884ebb5 in Status: IN_PROGRESS for 2s [ 1262.406952] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('30537957-1e35-4ca9-91d5-e2e0492569bd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.591668] env[70764]: INFO networking_nsxv3.common.synchronization [req-f9e2b007-7071-430d-97a9-8edb5a5a5386 req-6b9a53ec-9f9f-4b64-9fd9-6a27b6e36f85 tempest-ServerRescueTestJSONUnderV235-1098315367 tempest-ServerRescueTestJSONUnderV235-1098315367-project-member] Enqueued Resource ID: 14c59290-935a-4874-a961-0e5bb884ebb5 with Priority: HIGHEST for action security_group_members [ 1262.592318] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14c59290-935a-4874-a961-0e5bb884ebb5 with Priority: HIGHEST for action security_group_members [ 1262.592683] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-14c59290-935a-4874-a961-0e5bb884ebb5 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.592802] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.906663] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9325a264-8c44-482f-92be-005801a22ea6 in Status: SUCCESS [ 1262.907030] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.909236] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 30537957-1e35-4ca9-91d5-e2e0492569bd: rpc.has_security_group_logging(os_id): False [ 1262.925932] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.926124] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.926216] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.926375] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.926524] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.926709] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.926830] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.926883] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.927038] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.927165] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.927246] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30537957-1e35-4ca9-91d5-e2e0492569bd is going to be created. [ 1262.941290] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/30537957-1e35-4ca9-91d5-e2e0492569bd], does not exist path=[/infra/domains/default/groups/30537957-1e35-4ca9-91d5-e2e0492569bd]."\n}' [ 1262.941444] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30537957-1e35-4ca9-91d5-e2e0492569bd failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/30537957-1e35-4ca9-91d5-e2e0492569bd [ 1262.941548] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1262.974944] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.975211] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.975211] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.975386] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.976789] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.977224] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.977386] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.977439] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.977653] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.977913] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.977913] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.978068] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.978068] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.978223] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.978295] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.978380] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30537957-1e35-4ca9-91d5-e2e0492569bd is going to be created. [ 1262.989639] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/30537957-1e35-4ca9-91d5-e2e0492569bd], does not exist path=[/infra/domains/default/groups/30537957-1e35-4ca9-91d5-e2e0492569bd]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/30537957-1e35-4ca9-91d5-e2e0492569bd [ 1262.989767] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30537957-1e35-4ca9-91d5-e2e0492569bd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.989971] env[70764]: Traceback (most recent call last): [ 1262.990074] env[70764]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 1262.990074] env[70764]: return func(*args, **kwargs) [ 1262.990074] env[70764]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1262.990074] env[70764]: res.raise_for_status() [ 1262.990074] env[70764]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1262.990074] env[70764]: raise HTTPError(http_error_msg, response=self) [ 1262.990074] env[70764]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/30537957-1e35-4ca9-91d5-e2e0492569bd [ 1262.990074] env[70764]: During handling of the above exception, another exception occurred: [ 1262.990074] env[70764]: Traceback (most recent call last): [ 1262.990074] env[70764]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 1262.990074] env[70764]: listener.cb(fileno) [ 1262.990074] env[70764]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 1262.990074] env[70764]: result = function(*args, **kwargs) [ 1262.990074] env[70764]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 1262.990074] env[70764]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 1262.990074] env[70764]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 1262.990074] env[70764]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 1262.990074] env[70764]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 1262.990074] env[70764]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 1262.990074] env[70764]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1262.990074] env[70764]: res.raise_for_status() [ 1262.990074] env[70764]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1262.990074] env[70764]: raise HTTPError(http_error_msg, response=self) [ 1262.990074] env[70764]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/30537957-1e35-4ca9-91d5-e2e0492569bd [ 1262.990074] env[70764]: Removing descriptor: 20 [ 1262.990852] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b in Status: SUCCESS [ 1262.990852] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b deletion is rescheduled due to dependency. [ 1262.990920] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.915554] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14c59290-935a-4874-a961-0e5bb884ebb5 in Status: SUCCESS [ 1263.915937] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.916000] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.916256] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.916466] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.916644] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.916738] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.916988] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.917078] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.917158] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14c59290-935a-4874-a961-0e5bb884ebb5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.419029] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.419193] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.419260] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.419462] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.438477] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.438688] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.438797] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.438862] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.439040] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.439122] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.439209] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14c59290-935a-4874-a961-0e5bb884ebb5 is going to be updated. [ 1264.463102] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.463220] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.463290] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.463481] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.463628] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.470683] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14c59290-935a-4874-a961-0e5bb884ebb5 in Status: IN_PROGRESS for 2s [ 1266.481514] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14c59290-935a-4874-a961-0e5bb884ebb5 in Status: SUCCESS [ 1266.481875] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14c59290-935a-4874-a961-0e5bb884ebb5 deletion is rescheduled due to dependency. [ 1266.481875] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.481970] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.482138] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.482327] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.482442] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.482506] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.482666] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.482748] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.482843] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14c59290-935a-4874-a961-0e5bb884ebb5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.985101] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.985286] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.985358] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.985622] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.985732] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.985912] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.986021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.986083] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.986244] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.986318] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.986405] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14c59290-935a-4874-a961-0e5bb884ebb5 is going to be updated. [ 1267.045190] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.045190] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.045190] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.045190] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.045190] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.051894] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14c59290-935a-4874-a961-0e5bb884ebb5 in Status: IN_PROGRESS for 2s [ 1267.593736] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1267.594170] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 1268.782558] env[70764]: INFO networking_nsxv3.common.synchronization [req-a3e046a7-8798-4f3e-b165-af81fe1e626a req-5d25cb0c-77af-4d59-abf4-723b485d4cc5 tempest-ServerActionsTestOtherB-1188510512 tempest-ServerActionsTestOtherB-1188510512-project-member] Enqueued Resource ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b with Priority: HIGHEST for action security_group_members [ 1268.782558] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b with Priority: HIGHEST for action security_group_members [ 1268.782834] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.782945] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.783030] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.783219] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.783368] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.783524] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.783524] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.783719] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.783778] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.783839] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.034748] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-853 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.034963] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-853" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.035105] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-853" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.035379] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-853" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.035655] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.035823] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.035940] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.036179] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.036325] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.036537] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1269.036649] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1269.036759] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1269.036866] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1269.036974] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1269.037093] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1269.037378] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1269.055555] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1269.055716] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1269.055858] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1269.056033] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-853" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.056325] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-f5ae992c-fe2e-4338-89fb-ecab6ef33504 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.056486] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-f5ae992c-fe2e-4338-89fb-ecab6ef33504" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.056606] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-f5ae992c-fe2e-4338-89fb-ecab6ef33504" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.056948] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-f5ae992c-fe2e-4338-89fb-ecab6ef33504" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.057101] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5ae992c-fe2e-4338-89fb-ecab6ef33504',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.060175] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14c59290-935a-4874-a961-0e5bb884ebb5 in Status: SUCCESS [ 1269.060337] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14c59290-935a-4874-a961-0e5bb884ebb5 deletion is rescheduled due to dependency. [ 1269.060438] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.060592] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.060770] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.060929] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.061342] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.061342] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.061342] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.061342] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.061525] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.061525] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('14c59290-935a-4874-a961-0e5bb884ebb5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.062150] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.062311] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.062457] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.062556] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.062616] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.062746] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.062821] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.063044] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14c59290-935a-4874-a961-0e5bb884ebb5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.286740] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.286949] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.286949] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.287185] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.306299] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.306519] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.306651] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.306713] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.306880] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.306959] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.307058] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b is going to be updated. [ 1269.328271] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.328383] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.328451] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.328612] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.328742] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.336705] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b in Status: IN_PROGRESS for 2s [ 1269.559354] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.559577] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.559710] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.559991] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.560160] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.560315] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port f5ae992c-fe2e-4338-89fb-ecab6ef33504 not found, creating... [ 1269.560569] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.560728] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.560860] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.561091] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.561233] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.561510] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.561667] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.561787] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.561991] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.562139] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.562279] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: f5ae992c-fe2e-4338-89fb-ecab6ef33504 is going to be created. [ 1269.563827] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('14c59290-935a-4874-a961-0e5bb884ebb5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.564683] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.564792] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.564872] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.565255] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.565386] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.565551] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.565922] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.565922] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.565922] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.566103] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.566103] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14c59290-935a-4874-a961-0e5bb884ebb5 is going to be updated. [ 1269.585956] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.586232] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.586416] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.586695] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.586929] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.587196] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-f5ae992c-fe2e-4338-89fb-ecab6ef33504" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.590939] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.591089] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.591139] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.591316] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.591446] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.599089] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14c59290-935a-4874-a961-0e5bb884ebb5 in Status: IN_PROGRESS for 2s [ 1270.068251] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 14c59290-935a-4874-a961-0e5bb884ebb5: rpc.has_security_group_logging(os_id): False [ 1270.087024] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.087171] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.087227] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.087411] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.087499] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.087691] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.087793] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.087854] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.088043] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.088126] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.088214] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14c59290-935a-4874-a961-0e5bb884ebb5 is going to be updated. [ 1270.183470] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.183616] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.183700] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.183917] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.184136] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.197551] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14c59290-935a-4874-a961-0e5bb884ebb5 in Status: IN_PROGRESS for 2s [ 1270.247860] env[70764]: INFO networking_nsxv3.common.synchronization [req-a3e046a7-8798-4f3e-b165-af81fe1e626a req-f59e4f9d-4fe9-4dc4-900c-8cb1826fc73f service nova] Enqueued Resource ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b with Priority: HIGHEST for action security_group_rules [ 1270.248064] env[70764]: INFO networking_nsxv3.common.synchronization [req-a3e046a7-8798-4f3e-b165-af81fe1e626a req-f59e4f9d-4fe9-4dc4-900c-8cb1826fc73f service nova] Enqueued Resource ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b with Priority: HIGHEST for action security_group_members [ 1270.248207] env[70764]: INFO networking_nsxv3.common.synchronization [req-a3e046a7-8798-4f3e-b165-af81fe1e626a req-f59e4f9d-4fe9-4dc4-900c-8cb1826fc73f service nova] Enqueued Resource ID: f5ae992c-fe2e-4338-89fb-ecab6ef33504 with Priority: HIGHEST for action port [ 1270.248445] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b with Priority: HIGHEST for action security_group_rules [ 1270.248569] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b with Priority: HIGHEST for action security_group_members [ 1270.248662] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5ae992c-fe2e-4338-89fb-ecab6ef33504 with Priority: HIGHEST for action port [ 1270.249667] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.249798] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.249869] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.250093] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.250177] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.250965] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.251078] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.251320] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-f5ae992c-fe2e-4338-89fb-ecab6ef33504 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.251383] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f5ae992c-fe2e-4338-89fb-ecab6ef33504" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.251419] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f5ae992c-fe2e-4338-89fb-ecab6ef33504" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.251584] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f5ae992c-fe2e-4338-89fb-ecab6ef33504" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.251659] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5ae992c-fe2e-4338-89fb-ecab6ef33504',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.753238] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.753334] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.753485] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f5ae992c-fe2e-4338-89fb-ecab6ef33504 with status ACTIVE [ 1270.753733] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.753850] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.753918] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.754145] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.754236] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.754471] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.754528] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.754605] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.754722] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.754812] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.754985] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.755092] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.755147] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.755291] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.755364] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.755449] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f5ae992c-fe2e-4338-89fb-ecab6ef33504 is going to be updated. [ 1270.776275] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.776394] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.776503] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.776626] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.776779] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.776935] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f5ae992c-fe2e-4338-89fb-ecab6ef33504" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.291255] env[70764]: INFO networking_nsxv3.common.synchronization [req-af736c3d-b7ac-4d51-89a8-321377e0ad1e req-0cfb9ae4-1089-4573-b282-09bc3e68b610 tempest-AttachInterfacesTestJSON-1880347664 tempest-AttachInterfacesTestJSON-1880347664-project-member] Enqueued Resource ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb with Priority: HIGHEST for action security_group_members [ 1271.291805] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb with Priority: HIGHEST for action security_group_members [ 1271.292125] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b7cd2f4-04ff-4e32-a598-282852b38ebb taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.292265] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.292338] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.292515] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.292742] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.292833] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.292833] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.292963] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.293061] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.293191] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b7cd2f4-04ff-4e32-a598-282852b38ebb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.346126] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b in Status: SUCCESS [ 1271.346316] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b deletion is rescheduled due to dependency. [ 1271.346438] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.346650] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.347072] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.347072] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.347246] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.347246] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.347341] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.347388] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.347477] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.549245] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-822 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.549461] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-822" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.549598] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-822" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.549902] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-822" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.550213] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.550421] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.550560] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.550792] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.550943] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.551257] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1271.551416] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1271.551560] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1271.551684] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1271.551811] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1271.551948] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1271.552127] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1271.570030] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1271.570130] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1271.570273] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1271.570451] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-822" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.570745] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-b38dddcf-b887-4fc8-96da-0668ca52292a taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.570991] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-b38dddcf-b887-4fc8-96da-0668ca52292a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.571181] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-b38dddcf-b887-4fc8-96da-0668ca52292a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.571498] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-b38dddcf-b887-4fc8-96da-0668ca52292a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.571641] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b38dddcf-b887-4fc8-96da-0668ca52292a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.607755] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14c59290-935a-4874-a961-0e5bb884ebb5 in Status: SUCCESS [ 1271.607934] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14c59290-935a-4874-a961-0e5bb884ebb5 deletion is rescheduled due to dependency. [ 1271.608065] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.797502] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.797670] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.797734] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.797939] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.817847] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.818108] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.818226] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.818344] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.818485] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.818566] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.818654] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb is going to be updated. [ 1271.842090] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.842237] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.842426] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.842505] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.842624] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.848939] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.851347] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb in Status: IN_PROGRESS for 2s [ 1272.074319] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.074583] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.074719] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.074994] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.075230] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.075445] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port b38dddcf-b887-4fc8-96da-0668ca52292a not found, creating... [ 1272.075811] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.076049] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.076258] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.076560] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.076800] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.077139] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.077352] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.077498] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.077729] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.077950] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.078190] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: b38dddcf-b887-4fc8-96da-0668ca52292a is going to be created. [ 1272.097092] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.097299] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.097475] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.098079] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.098079] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.098327] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-b38dddcf-b887-4fc8-96da-0668ca52292a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.209927] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14c59290-935a-4874-a961-0e5bb884ebb5 in Status: SUCCESS [ 1272.210240] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.210414] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.210649] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.210746] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14c59290-935a-4874-a961-0e5bb884ebb5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.350837] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.729819] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.730022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.730133] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.730375] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.745293] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.745396] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14c59290-935a-4874-a961-0e5bb884ebb5 is going to be deleted. [ 1272.784311] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.784446] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.785017] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.785017] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.785017] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.785017] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14c59290-935a-4874-a961-0e5bb884ebb5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.798767] env[70764]: INFO networking_nsxv3.common.synchronization [req-af736c3d-b7ac-4d51-89a8-321377e0ad1e req-8dbb49d3-da52-44b1-b52b-5235ce6396d8 service nova] Enqueued Resource ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb with Priority: HIGHEST for action security_group_rules [ 1272.798948] env[70764]: INFO networking_nsxv3.common.synchronization [req-af736c3d-b7ac-4d51-89a8-321377e0ad1e req-8dbb49d3-da52-44b1-b52b-5235ce6396d8 service nova] Enqueued Resource ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb with Priority: HIGHEST for action security_group_members [ 1272.799107] env[70764]: INFO networking_nsxv3.common.synchronization [req-af736c3d-b7ac-4d51-89a8-321377e0ad1e req-8dbb49d3-da52-44b1-b52b-5235ce6396d8 service nova] Enqueued Resource ID: b38dddcf-b887-4fc8-96da-0668ca52292a with Priority: HIGHEST for action port [ 1272.799339] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb with Priority: HIGHEST for action security_group_rules [ 1272.799485] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb with Priority: HIGHEST for action security_group_members [ 1272.799546] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b38dddcf-b887-4fc8-96da-0668ca52292a with Priority: HIGHEST for action port [ 1272.800085] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b7cd2f4-04ff-4e32-a598-282852b38ebb taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.800209] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.800270] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.800469] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.800546] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b7cd2f4-04ff-4e32-a598-282852b38ebb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.801416] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b7cd2f4-04ff-4e32-a598-282852b38ebb taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.801525] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.801631] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-b38dddcf-b887-4fc8-96da-0668ca52292a taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.801723] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b38dddcf-b887-4fc8-96da-0668ca52292a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.801781] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b38dddcf-b887-4fc8-96da-0668ca52292a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.802139] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b38dddcf-b887-4fc8-96da-0668ca52292a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.802139] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b38dddcf-b887-4fc8-96da-0668ca52292a',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.852796] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.852936] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.852982] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.853213] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.853302] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.853402] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b is going to be updated. [ 1272.896842] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.897000] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.897079] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.897284] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.897421] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.906451] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b in Status: IN_PROGRESS for 2s [ 1273.304091] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b7cd2f4-04ff-4e32-a598-282852b38ebb taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.304244] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.304435] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b38dddcf-b887-4fc8-96da-0668ca52292a with status ACTIVE [ 1273.304609] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.304717] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.305030] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.305030] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.305164] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.305261] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.305357] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.305418] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.305570] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.305701] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.305899] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.305998] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.306072] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.306215] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.306289] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.306374] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b38dddcf-b887-4fc8-96da-0668ca52292a is going to be updated. [ 1273.336655] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.336850] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.336850] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.337026] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.337158] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.337316] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b38dddcf-b887-4fc8-96da-0668ca52292a" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.860597] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb in Status: SUCCESS [ 1273.860930] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb deletion is rescheduled due to dependency. [ 1273.860930] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.861050] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.861330] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.861511] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.861627] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.861691] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.861837] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.861917] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.862018] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b7cd2f4-04ff-4e32-a598-282852b38ebb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.364279] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9b7cd2f4-04ff-4e32-a598-282852b38ebb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.866805] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9b7cd2f4-04ff-4e32-a598-282852b38ebb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.916618] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b in Status: SUCCESS [ 1274.916879] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.917049] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.917290] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.917485] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.917600] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.917665] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.917819] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.917899] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.917985] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.918089] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.369522] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.369715] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.369715] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.369938] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.370038] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.370182] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb is going to be updated. [ 1275.398646] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.398646] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.398646] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.398898] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.398898] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.406960] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb in Status: IN_PROGRESS for 2s [ 1275.420367] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.922949] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b: rpc.has_security_group_logging(os_id): False [ 1275.941404] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.941611] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.941611] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.941954] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.942059] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.942321] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.942443] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.942500] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.942653] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.942726] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.942816] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b is going to be updated. [ 1275.996745] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.996969] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.997039] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.997257] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.997403] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.007647] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b in Status: IN_PROGRESS for 2s [ 1277.404402] env[70764]: INFO networking_nsxv3.common.synchronization [None req-0bea3b40-37cb-4797-95f4-00438fe1bdc3 tempest-AttachInterfacesTestJSON-1880347664 tempest-AttachInterfacesTestJSON-1880347664-project-member] Enqueued Resource ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb with Priority: HIGHEST for action security_group_members [ 1277.405081] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb with Priority: HIGHEST for action security_group_members [ 1277.405443] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b7cd2f4-04ff-4e32-a598-282852b38ebb taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.405578] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.417326] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb in Status: SUCCESS [ 1277.417578] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.417763] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.418069] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.418362] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.418514] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.418593] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.418818] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.418941] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.419089] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.419219] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9b7cd2f4-04ff-4e32-a598-282852b38ebb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.423702] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.423702] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.423702] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.423702] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.423702] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.423702] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.423702] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.423702] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b7cd2f4-04ff-4e32-a598-282852b38ebb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.923070] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b7cd2f4-04ff-4e32-a598-282852b38ebb taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.923070] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.928559] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9b7cd2f4-04ff-4e32-a598-282852b38ebb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.019852] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b in Status: SUCCESS [ 1278.020178] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.430766] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9b7cd2f4-04ff-4e32-a598-282852b38ebb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.933525] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.933721] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.933838] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.934012] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.934116] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.934216] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb is going to be updated. [ 1278.967060] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.967060] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.967060] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.967060] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.967060] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.974526] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb in Status: IN_PROGRESS for 2s [ 1279.733997] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-822 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.734354] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-822" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.734354] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-822" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.735031] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-822" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.735031] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.735031] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.735266] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.735480] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.735632] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.735874] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1279.735992] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1279.736114] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1279.736224] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1279.736339] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1279.736450] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1279.736586] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1279.761377] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1279.761533] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1279.761668] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1279.761837] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-822" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.762137] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-585825ff-c0f6-4899-9e00-7684c03d62c4 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.762302] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-585825ff-c0f6-4899-9e00-7684c03d62c4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.762425] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-585825ff-c0f6-4899-9e00-7684c03d62c4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.762773] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-585825ff-c0f6-4899-9e00-7684c03d62c4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.762914] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('585825ff-c0f6-4899-9e00-7684c03d62c4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.265572] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.265818] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.265954] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.266260] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.266414] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.266573] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 585825ff-c0f6-4899-9e00-7684c03d62c4 not found, creating... [ 1280.267048] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.267168] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.267348] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.267679] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.267950] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.268394] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.268689] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.268899] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.269307] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.269571] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.269800] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 585825ff-c0f6-4899-9e00-7684c03d62c4 is going to be created. [ 1280.291366] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.291575] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.291704] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.291952] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.292357] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.292517] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-585825ff-c0f6-4899-9e00-7684c03d62c4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.962883] env[70764]: INFO networking_nsxv3.common.synchronization [req-455bd5ea-a18e-41f6-b378-27cdd3ac4e98 req-6217539d-b2ea-4745-9780-dedea325659a service nova] Enqueued Resource ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb with Priority: HIGHEST for action security_group_rules [ 1280.963188] env[70764]: INFO networking_nsxv3.common.synchronization [req-455bd5ea-a18e-41f6-b378-27cdd3ac4e98 req-6217539d-b2ea-4745-9780-dedea325659a service nova] Enqueued Resource ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb with Priority: HIGHEST for action security_group_members [ 1280.963235] env[70764]: INFO networking_nsxv3.common.synchronization [req-455bd5ea-a18e-41f6-b378-27cdd3ac4e98 req-6217539d-b2ea-4745-9780-dedea325659a service nova] Enqueued Resource ID: 585825ff-c0f6-4899-9e00-7684c03d62c4 with Priority: HIGHEST for action port [ 1280.963812] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb with Priority: HIGHEST for action security_group_rules [ 1280.963905] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb with Priority: HIGHEST for action security_group_members [ 1280.963954] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 585825ff-c0f6-4899-9e00-7684c03d62c4 with Priority: HIGHEST for action port [ 1280.965270] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b7cd2f4-04ff-4e32-a598-282852b38ebb taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.965388] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.965688] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b7cd2f4-04ff-4e32-a598-282852b38ebb taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.965820] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.966081] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-585825ff-c0f6-4899-9e00-7684c03d62c4 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.966214] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-585825ff-c0f6-4899-9e00-7684c03d62c4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.966303] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-585825ff-c0f6-4899-9e00-7684c03d62c4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.966527] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-585825ff-c0f6-4899-9e00-7684c03d62c4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.966639] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('585825ff-c0f6-4899-9e00-7684c03d62c4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.983670] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb in Status: SUCCESS [ 1280.983875] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.984035] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.984241] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.984416] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.984527] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.984586] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.984738] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.984819] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.984912] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.985063] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b7cd2f4-04ff-4e32-a598-282852b38ebb taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.985174] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.985250] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.985333] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.985470] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.985581] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.985624] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.985779] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.985911] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.985911] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.985992] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9b7cd2f4-04ff-4e32-a598-282852b38ebb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.987160] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.987315] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.987467] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.987564] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.987621] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.987964] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.987964] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.987964] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b7cd2f4-04ff-4e32-a598-282852b38ebb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.468255] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 585825ff-c0f6-4899-9e00-7684c03d62c4 with status ACTIVE [ 1281.468482] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.468693] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.468765] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.469064] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.469166] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.469377] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.469489] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.469546] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.469707] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.469789] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.469963] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.470078] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.470133] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.470270] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.470344] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.470429] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 585825ff-c0f6-4899-9e00-7684c03d62c4 is going to be updated. [ 1281.488997] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9b7cd2f4-04ff-4e32-a598-282852b38ebb: rpc.has_security_group_logging(os_id): False [ 1281.489918] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9b7cd2f4-04ff-4e32-a598-282852b38ebb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.491687] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.491799] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.491885] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.492295] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.492499] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.492662] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-585825ff-c0f6-4899-9e00-7684c03d62c4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.505220] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.505338] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.505433] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.505549] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.505627] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.505823] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.505976] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.506061] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.506153] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.506230] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.506413] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.506507] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.506566] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.506718] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.506791] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.507013] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.507114] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.507177] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.507310] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.507628] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.507628] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb is going to be updated. [ 1281.609273] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.609471] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.609471] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.609670] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.609799] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.624477] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb in Status: IN_PROGRESS for 2s [ 1281.993891] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9b7cd2f4-04ff-4e32-a598-282852b38ebb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.496227] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.496360] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.496407] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.496613] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.496698] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.496798] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb is going to be updated. [ 1282.524624] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.524753] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.524797] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.524986] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.525140] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.533229] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb in Status: IN_PROGRESS for 2s [ 1283.638028] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb in Status: SUCCESS [ 1283.638296] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.638470] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.638682] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.638772] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b7cd2f4-04ff-4e32-a598-282852b38ebb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.846546] env[70764]: INFO networking_nsxv3.common.synchronization [req-0898ff1e-25cf-4262-8fbe-cfa1b4631b38 req-21d6963c-26bd-4da5-a25b-dd51ea3a5e00 tempest-ServerActionsTestOtherA-1368461845 tempest-ServerActionsTestOtherA-1368461845-project-member] Enqueued Resource ID: 9325a264-8c44-482f-92be-005801a22ea6 with Priority: HIGHEST for action security_group_members [ 1283.847079] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9325a264-8c44-482f-92be-005801a22ea6 with Priority: HIGHEST for action security_group_members [ 1283.847386] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9325a264-8c44-482f-92be-005801a22ea6 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.847510] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.847577] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.847782] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.847941] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.848186] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.848259] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.848448] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.848545] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.848651] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9325a264-8c44-482f-92be-005801a22ea6',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.144700] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b7cd2f4-04ff-4e32-a598-282852b38ebb taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.144700] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.351796] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.352016] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.352016] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.352298] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.372917] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.373193] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.373319] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.373385] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.373580] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.373666] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.373754] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9325a264-8c44-482f-92be-005801a22ea6 is going to be updated. [ 1284.401789] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.401911] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.401970] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.402204] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.402377] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.415602] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9325a264-8c44-482f-92be-005801a22ea6 in Status: IN_PROGRESS for 2s [ 1284.542979] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb in Status: SUCCESS [ 1284.543192] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.543359] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.543570] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.543827] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.543963] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.544039] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.544200] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.544282] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.544368] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.544456] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9b7cd2f4-04ff-4e32-a598-282852b38ebb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.046680] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b7cd2f4-04ff-4e32-a598-282852b38ebb taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.047122] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.047122] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.047263] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.047314] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.047454] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.047529] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.047683] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.047771] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.047865] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.048033] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b7cd2f4-04ff-4e32-a598-282852b38ebb taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.048124] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.048180] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.048326] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.048494] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.048591] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.048641] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.048777] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.048871] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.048992] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.049105] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9b7cd2f4-04ff-4e32-a598-282852b38ebb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.552028] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9b7cd2f4-04ff-4e32-a598-282852b38ebb: rpc.has_security_group_logging(os_id): False [ 1285.572244] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.572424] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.572492] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.572704] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.572798] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.573010] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.573114] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.573177] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.573335] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.573412] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.573604] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.573721] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.573788] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.573927] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.574009] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.574233] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.574329] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.574389] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.574529] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.574603] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.574691] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb is going to be updated. [ 1285.650900] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.651069] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.651131] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.651337] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.651480] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.663622] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb in Status: IN_PROGRESS for 2s [ 1286.425320] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9325a264-8c44-482f-92be-005801a22ea6 in Status: SUCCESS [ 1286.425614] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9325a264-8c44-482f-92be-005801a22ea6 deletion is rescheduled due to dependency. [ 1286.425715] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.683120] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb in Status: SUCCESS [ 1287.683410] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.032829] env[70764]: INFO networking_nsxv3.common.synchronization [None req-0ff2dbc5-1184-4677-9331-404f6b8a4a3c tempest-ServerActionsTestOtherA-1368461845 tempest-ServerActionsTestOtherA-1368461845-project-member] Enqueued Resource ID: 1b95a529-ab96-4208-bb4b-7d6d16bf8877 with Priority: HIGHEST for action security_group_rules [ 1288.033405] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b95a529-ab96-4208-bb4b-7d6d16bf8877 with Priority: HIGHEST for action security_group_rules [ 1288.033726] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b95a529-ab96-4208-bb4b-7d6d16bf8877 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.033863] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b95a529-ab96-4208-bb4b-7d6d16bf8877" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.033935] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b95a529-ab96-4208-bb4b-7d6d16bf8877" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.034321] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b95a529-ab96-4208-bb4b-7d6d16bf8877" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.034406] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b95a529-ab96-4208-bb4b-7d6d16bf8877',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.106951] env[70764]: INFO networking_nsxv3.common.synchronization [None req-c2b4d503-15c9-4d95-891b-6f1bc1dd8975 tempest-ServerActionsTestOtherA-1368461845 tempest-ServerActionsTestOtherA-1368461845-project-member] Enqueued Resource ID: 1b95a529-ab96-4208-bb4b-7d6d16bf8877 with Priority: HIGHEST for action security_group_rules [ 1288.107137] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b95a529-ab96-4208-bb4b-7d6d16bf8877 with Priority: HIGHEST for action security_group_rules [ 1288.107467] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b95a529-ab96-4208-bb4b-7d6d16bf8877 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.107573] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b95a529-ab96-4208-bb4b-7d6d16bf8877" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.555358] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.555543] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.555632] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.555892] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.556029] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.556113] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b95a529-ab96-4208-bb4b-7d6d16bf8877 already deleted. [ 1288.556183] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b95a529-ab96-4208-bb4b-7d6d16bf8877" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.556350] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b95a529-ab96-4208-bb4b-7d6d16bf8877" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.556506] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b95a529-ab96-4208-bb4b-7d6d16bf8877" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.556606] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b95a529-ab96-4208-bb4b-7d6d16bf8877',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.078119] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.078507] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.078507] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.078582] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.078615] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.078803] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b95a529-ab96-4208-bb4b-7d6d16bf8877 already deleted. [ 1289.078932] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b95a529-ab96-4208-bb4b-7d6d16bf8877" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.769408] env[70764]: INFO networking_nsxv3.common.synchronization [req-95732930-65d3-45f5-9403-ba74ae96ee2b req-c5ec0cf0-ab75-4f8c-862c-7ef31548e5e0 tempest-ServerActionsTestJSON-288318646 tempest-ServerActionsTestJSON-288318646-project-member] Enqueued Resource ID: 527aa039-9b45-4682-bffb-ac71e24551a1 with Priority: HIGHEST for action security_group_members [ 1290.769876] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 527aa039-9b45-4682-bffb-ac71e24551a1 with Priority: HIGHEST for action security_group_members [ 1290.770194] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-527aa039-9b45-4682-bffb-ac71e24551a1 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.770317] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.770379] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.770568] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.770718] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.770820] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.770903] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.771182] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.771223] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.771306] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('527aa039-9b45-4682-bffb-ac71e24551a1',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.274190] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.274426] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.274426] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.274634] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.296417] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.296625] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.296739] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.296821] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.296969] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.297067] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.297156] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 527aa039-9b45-4682-bffb-ac71e24551a1 is going to be updated. [ 1291.324493] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.324675] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.324675] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.324823] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.324944] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.333558] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 527aa039-9b45-4682-bffb-ac71e24551a1 in Status: IN_PROGRESS for 2s [ 1292.849022] env[70764]: INFO networking_nsxv3.common.synchronization [req-e1daff5d-ba15-42ce-b0aa-0dbd442569a0 req-dd166abd-fddd-46d8-9a4e-042719fc78b5 tempest-AttachInterfacesTestJSON-1880347664 tempest-AttachInterfacesTestJSON-1880347664-project-member] Enqueued Resource ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb with Priority: HIGHEST for action security_group_members [ 1292.849370] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb with Priority: HIGHEST for action security_group_members [ 1292.849682] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b7cd2f4-04ff-4e32-a598-282852b38ebb taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.849807] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.849875] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.850085] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.850237] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.850333] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.850391] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.850541] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.850626] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.850719] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b7cd2f4-04ff-4e32-a598-282852b38ebb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.352026] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 527aa039-9b45-4682-bffb-ac71e24551a1 in Status: SUCCESS [ 1293.352184] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 527aa039-9b45-4682-bffb-ac71e24551a1 deletion is rescheduled due to dependency. [ 1293.352225] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.352456] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9b7cd2f4-04ff-4e32-a598-282852b38ebb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.379770] env[70764]: INFO networking_nsxv3.common.synchronization [None req-7875fc34-b34f-4940-9d49-35fb018b310b tempest-AttachInterfacesTestJSON-1880347664 tempest-AttachInterfacesTestJSON-1880347664-project-member] Enqueued Resource ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb with Priority: HIGHEST for action security_group_members [ 1293.380269] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb with Priority: HIGHEST for action security_group_members [ 1293.380574] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b7cd2f4-04ff-4e32-a598-282852b38ebb taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.380929] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.428338] env[70764]: INFO networking_nsxv3.common.synchronization [req-b3a68da1-8912-445b-a6a2-5309977ea94b req-c79bb40c-a2be-4f9a-8c73-2f238b97de52 tempest-ServerActionsTestOtherA-1368461845 tempest-ServerActionsTestOtherA-1368461845-project-member] Enqueued Resource ID: 1b95a529-ab96-4208-bb4b-7d6d16bf8877 with Priority: HIGHEST for action security_group_members [ 1293.428830] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b95a529-ab96-4208-bb4b-7d6d16bf8877 with Priority: HIGHEST for action security_group_members [ 1293.429313] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b95a529-ab96-4208-bb4b-7d6d16bf8877 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.429313] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b95a529-ab96-4208-bb4b-7d6d16bf8877" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.429545] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b95a529-ab96-4208-bb4b-7d6d16bf8877" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.429626] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b95a529-ab96-4208-bb4b-7d6d16bf8877" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.429962] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.429962] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.429962] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.430227] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.430227] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.430227] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b95a529-ab96-4208-bb4b-7d6d16bf8877',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.697535] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-388 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.697767] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-388" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.697899] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-388" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.698219] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-388" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.698502] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.698667] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.698785] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.699101] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.699248] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.699464] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1293.699579] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1293.699689] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1293.699797] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1293.699905] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1293.700022] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1293.700264] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1293.727733] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1293.727898] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1293.728050] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1293.728233] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-388" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.728532] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-feb6fbca-665c-4cec-90bb-75b5ac4219c5 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.728701] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-feb6fbca-665c-4cec-90bb-75b5ac4219c5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.728837] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-feb6fbca-665c-4cec-90bb-75b5ac4219c5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.729640] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-feb6fbca-665c-4cec-90bb-75b5ac4219c5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.729640] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('feb6fbca-665c-4cec-90bb-75b5ac4219c5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.854822] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9b7cd2f4-04ff-4e32-a598-282852b38ebb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.931850] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.932036] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.932112] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.932330] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.932420] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.932617] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.932714] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.932777] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.932922] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.932998] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.933095] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b95a529-ab96-4208-bb4b-7d6d16bf8877 already deleted. [ 1293.933178] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b95a529-ab96-4208-bb4b-7d6d16bf8877" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.231749] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.232076] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.232267] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.232639] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.232854] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.233100] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port feb6fbca-665c-4cec-90bb-75b5ac4219c5 not found, creating... [ 1294.233482] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.233712] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.233904] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.234215] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.234414] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.234797] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.235014] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.235209] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.235518] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.235704] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.235911] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: feb6fbca-665c-4cec-90bb-75b5ac4219c5 is going to be created. [ 1294.255575] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.255787] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.255943] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.256232] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.256461] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.256681] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-feb6fbca-665c-4cec-90bb-75b5ac4219c5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.261601] env[70764]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1294.261721] env[70764]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] NSXv3 Agent Agent loop - iteration:3 started [ 1294.358048] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.358232] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.358284] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.358495] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.358585] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.358686] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb is going to be updated. [ 1294.417481] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.417618] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.417693] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.417904] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.418141] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.433400] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb in Status: IN_PROGRESS for 2s [ 1294.917161] env[70764]: INFO networking_nsxv3.common.synchronization [req-b3a68da1-8912-445b-a6a2-5309977ea94b req-e31983da-7717-4fbd-bd5f-04f14c1eed2c service nova] Enqueued Resource ID: 1b95a529-ab96-4208-bb4b-7d6d16bf8877 with Priority: HIGHEST for action security_group_rules [ 1294.917161] env[70764]: INFO networking_nsxv3.common.synchronization [req-b3a68da1-8912-445b-a6a2-5309977ea94b req-e31983da-7717-4fbd-bd5f-04f14c1eed2c service nova] Enqueued Resource ID: 1b95a529-ab96-4208-bb4b-7d6d16bf8877 with Priority: HIGHEST for action security_group_members [ 1294.917161] env[70764]: INFO networking_nsxv3.common.synchronization [req-b3a68da1-8912-445b-a6a2-5309977ea94b req-e31983da-7717-4fbd-bd5f-04f14c1eed2c service nova] Enqueued Resource ID: feb6fbca-665c-4cec-90bb-75b5ac4219c5 with Priority: HIGHEST for action port [ 1294.917161] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b95a529-ab96-4208-bb4b-7d6d16bf8877 with Priority: HIGHEST for action security_group_rules [ 1294.917161] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b95a529-ab96-4208-bb4b-7d6d16bf8877 with Priority: HIGHEST for action security_group_members [ 1294.917161] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: feb6fbca-665c-4cec-90bb-75b5ac4219c5 with Priority: HIGHEST for action port [ 1294.917712] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b95a529-ab96-4208-bb4b-7d6d16bf8877 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.917950] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b95a529-ab96-4208-bb4b-7d6d16bf8877" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.918140] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b95a529-ab96-4208-bb4b-7d6d16bf8877" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.918551] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b95a529-ab96-4208-bb4b-7d6d16bf8877" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.918724] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b95a529-ab96-4208-bb4b-7d6d16bf8877',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.919802] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b95a529-ab96-4208-bb4b-7d6d16bf8877 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.920033] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b95a529-ab96-4208-bb4b-7d6d16bf8877" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.920194] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b95a529-ab96-4208-bb4b-7d6d16bf8877" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.920441] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b95a529-ab96-4208-bb4b-7d6d16bf8877" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.922017] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.922017] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.922017] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.922017] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.922017] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.922017] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b95a529-ab96-4208-bb4b-7d6d16bf8877',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.922608] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-feb6fbca-665c-4cec-90bb-75b5ac4219c5 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.922836] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-feb6fbca-665c-4cec-90bb-75b5ac4219c5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.923019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-feb6fbca-665c-4cec-90bb-75b5ac4219c5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.923266] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-feb6fbca-665c-4cec-90bb-75b5ac4219c5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.923428] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('feb6fbca-665c-4cec-90bb-75b5ac4219c5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.425495] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b95a529-ab96-4208-bb4b-7d6d16bf8877 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.425630] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b95a529-ab96-4208-bb4b-7d6d16bf8877" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.425953] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1b95a529-ab96-4208-bb4b-7d6d16bf8877',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.427061] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port feb6fbca-665c-4cec-90bb-75b5ac4219c5 with status ACTIVE [ 1295.427289] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.427411] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.427480] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.427675] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.427763] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.427933] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.428039] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.428103] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.428248] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.428326] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.428502] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.428596] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.428657] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.428793] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.428866] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.428952] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: feb6fbca-665c-4cec-90bb-75b5ac4219c5 is going to be updated. [ 1295.450782] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.450782] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.450782] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.450994] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.450994] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.451156] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-feb6fbca-665c-4cec-90bb-75b5ac4219c5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.931119] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1b95a529-ab96-4208-bb4b-7d6d16bf8877',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.433533] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.433682] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.433726] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.434047] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.435152] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.435152] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b95a529-ab96-4208-bb4b-7d6d16bf8877 is going to be created. [ 1296.443314] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb in Status: SUCCESS [ 1296.443515] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.443661] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.443843] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.444028] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.444145] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.444208] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.444352] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.444432] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.444524] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b7cd2f4-04ff-4e32-a598-282852b38ebb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.456042] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.456042] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.456042] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.456042] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.456042] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.463814] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b95a529-ab96-4208-bb4b-7d6d16bf8877 in Status: UNINITIALIZED for 2s [ 1296.946690] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.947078] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.947078] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.947232] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.947333] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.947538] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.947642] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.947706] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.947859] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.947939] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.948047] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb is going to be updated. [ 1296.972171] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.972321] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.972368] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.972515] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.972662] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.981798] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb in Status: IN_PROGRESS for 2s [ 1297.760040] env[70764]: INFO networking_nsxv3.common.synchronization [req-e1b4458a-ec46-4ac7-acdf-60a1fba83180 req-09d6d8e6-45a1-4e71-94c8-bb3352661842 tempest-ServerActionsTestJSON-288318646 tempest-ServerActionsTestJSON-288318646-project-member] Enqueued Resource ID: 527aa039-9b45-4682-bffb-ac71e24551a1 with Priority: HIGHEST for action security_group_members [ 1297.762310] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 527aa039-9b45-4682-bffb-ac71e24551a1 with Priority: HIGHEST for action security_group_members [ 1297.762310] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-527aa039-9b45-4682-bffb-ac71e24551a1 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.762310] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.762310] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.762310] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.762310] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.762310] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.762310] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.762310] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.762310] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.762310] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('527aa039-9b45-4682-bffb-ac71e24551a1',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.047379] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-803 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.047730] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-803" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.047730] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-803" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.047957] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-803" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.048260] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.048426] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.048546] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.048764] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.048909] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.049134] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1298.049251] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1298.049365] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1298.049474] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1298.049581] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1298.049686] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1298.049792] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1298.068983] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1298.069243] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1298.069502] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1298.069719] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-803" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.070182] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-c6fab558-def1-44f7-8d83-4b1eeacc1bf1 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.070386] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-c6fab558-def1-44f7-8d83-4b1eeacc1bf1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.070509] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-c6fab558-def1-44f7-8d83-4b1eeacc1bf1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.070833] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-c6fab558-def1-44f7-8d83-4b1eeacc1bf1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.070975] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6fab558-def1-44f7-8d83-4b1eeacc1bf1',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.263719] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.263974] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.264075] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.264288] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.264383] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.264592] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.264693] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.264755] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.264904] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.264980] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.265078] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 527aa039-9b45-4682-bffb-ac71e24551a1 is going to be updated. [ 1298.295660] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.295807] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.296260] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.296260] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.296260] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.307748] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 527aa039-9b45-4682-bffb-ac71e24551a1 in Status: IN_PROGRESS for 2s [ 1298.475983] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b95a529-ab96-4208-bb4b-7d6d16bf8877 in Status: SUCCESS [ 1298.476225] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b95a529-ab96-4208-bb4b-7d6d16bf8877" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.476380] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b95a529-ab96-4208-bb4b-7d6d16bf8877" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.476583] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b95a529-ab96-4208-bb4b-7d6d16bf8877" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.476771] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.476887] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.476956] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.477131] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.477209] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.477295] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b95a529-ab96-4208-bb4b-7d6d16bf8877" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.477383] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1b95a529-ab96-4208-bb4b-7d6d16bf8877',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.573537] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.573847] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.574053] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.574388] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.575030] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.575030] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port c6fab558-def1-44f7-8d83-4b1eeacc1bf1 not found, creating... [ 1298.575169] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.575382] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.575653] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.576193] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.576445] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.576846] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.577092] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.577251] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.577544] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.577747] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.577958] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: c6fab558-def1-44f7-8d83-4b1eeacc1bf1 is going to be created. [ 1298.598605] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.598932] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.599166] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.599527] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.599872] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.600206] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-c6fab558-def1-44f7-8d83-4b1eeacc1bf1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.979931] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1b95a529-ab96-4208-bb4b-7d6d16bf8877',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.990696] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb in Status: SUCCESS [ 1298.990865] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb deletion is rescheduled due to dependency. [ 1298.990977] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.284467] env[70764]: INFO networking_nsxv3.common.synchronization [req-e1b4458a-ec46-4ac7-acdf-60a1fba83180 req-dd09c2ed-7b0d-4322-9c53-eaa0ded8d548 service nova] Enqueued Resource ID: 527aa039-9b45-4682-bffb-ac71e24551a1 with Priority: HIGHEST for action security_group_rules [ 1299.284710] env[70764]: INFO networking_nsxv3.common.synchronization [req-e1b4458a-ec46-4ac7-acdf-60a1fba83180 req-dd09c2ed-7b0d-4322-9c53-eaa0ded8d548 service nova] Enqueued Resource ID: 527aa039-9b45-4682-bffb-ac71e24551a1 with Priority: HIGHEST for action security_group_members [ 1299.284837] env[70764]: INFO networking_nsxv3.common.synchronization [req-e1b4458a-ec46-4ac7-acdf-60a1fba83180 req-dd09c2ed-7b0d-4322-9c53-eaa0ded8d548 service nova] Enqueued Resource ID: c6fab558-def1-44f7-8d83-4b1eeacc1bf1 with Priority: HIGHEST for action port [ 1299.285258] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 527aa039-9b45-4682-bffb-ac71e24551a1 with Priority: HIGHEST for action security_group_rules [ 1299.285398] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 527aa039-9b45-4682-bffb-ac71e24551a1 with Priority: HIGHEST for action security_group_members [ 1299.286505] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6fab558-def1-44f7-8d83-4b1eeacc1bf1 with Priority: HIGHEST for action port [ 1299.286770] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-527aa039-9b45-4682-bffb-ac71e24551a1 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.286912] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.286980] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.287192] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.287278] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('527aa039-9b45-4682-bffb-ac71e24551a1',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.288106] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-527aa039-9b45-4682-bffb-ac71e24551a1 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.288204] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.288394] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6fab558-def1-44f7-8d83-4b1eeacc1bf1 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.288803] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6fab558-def1-44f7-8d83-4b1eeacc1bf1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.288893] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6fab558-def1-44f7-8d83-4b1eeacc1bf1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.289086] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6fab558-def1-44f7-8d83-4b1eeacc1bf1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.289167] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6fab558-def1-44f7-8d83-4b1eeacc1bf1',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.482584] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1b95a529-ab96-4208-bb4b-7d6d16bf8877: rpc.has_security_group_logging(os_id): False [ 1299.499306] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.499567] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.499623] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.499873] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.499968] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.500403] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.500539] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.500609] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.500851] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.501015] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.501185] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b95a529-ab96-4208-bb4b-7d6d16bf8877 is going to be created. [ 1299.560698] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.560992] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.560992] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.561144] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.561348] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.571810] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1b95a529-ab96-4208-bb4b-7d6d16bf8877 in Status: IN_PROGRESS for 2s [ 1299.791138] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-527aa039-9b45-4682-bffb-ac71e24551a1 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.791297] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.791456] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c6fab558-def1-44f7-8d83-4b1eeacc1bf1 with status ACTIVE [ 1299.791623] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.791731] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.791796] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.792021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.792110] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.792448] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.792448] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.792448] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.792618] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.792656] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.792835] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.792928] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.792989] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.793144] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.793219] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.793301] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c6fab558-def1-44f7-8d83-4b1eeacc1bf1 is going to be updated. [ 1299.814468] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.814617] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.814617] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.814757] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.814881] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.815033] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6fab558-def1-44f7-8d83-4b1eeacc1bf1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.318032] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 527aa039-9b45-4682-bffb-ac71e24551a1 in Status: SUCCESS [ 1300.318032] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 527aa039-9b45-4682-bffb-ac71e24551a1 deletion is rescheduled due to dependency. [ 1300.318477] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.318618] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.318832] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.319049] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.319209] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.319286] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.319387] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.319467] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.319563] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('527aa039-9b45-4682-bffb-ac71e24551a1',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.822132] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('527aa039-9b45-4682-bffb-ac71e24551a1',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.323830] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('527aa039-9b45-4682-bffb-ac71e24551a1',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.585178] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1b95a529-ab96-4208-bb4b-7d6d16bf8877 in Status: SUCCESS [ 1301.585410] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b95a529-ab96-4208-bb4b-7d6d16bf8877" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.826705] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.826805] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.826850] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.827138] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.827238] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.827344] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 527aa039-9b45-4682-bffb-ac71e24551a1 is going to be updated. [ 1301.857192] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.857376] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.857458] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.857698] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.857846] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.867509] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 527aa039-9b45-4682-bffb-ac71e24551a1 in Status: IN_PROGRESS for 2s [ 1301.964141] env[70764]: INFO networking_nsxv3.common.synchronization [req-ea5c2554-a0d1-4cc3-9b32-f67d438b0874 req-d78e85c9-a32c-40bc-9ab3-0418f15bc087 tempest-AttachInterfacesTestJSON-1880347664 tempest-AttachInterfacesTestJSON-1880347664-project-member] Enqueued Resource ID: 388683b1-8e17-479d-9f16-8fe7821a0ef8 with Priority: HIGHEST for action security_group_members [ 1301.964141] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 388683b1-8e17-479d-9f16-8fe7821a0ef8 with Priority: HIGHEST for action security_group_members [ 1301.964141] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-388683b1-8e17-479d-9f16-8fe7821a0ef8 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.964141] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-388683b1-8e17-479d-9f16-8fe7821a0ef8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.964141] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-388683b1-8e17-479d-9f16-8fe7821a0ef8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.964141] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-388683b1-8e17-479d-9f16-8fe7821a0ef8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.964141] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.964141] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.964141] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.964141] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.965398] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.965630] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('388683b1-8e17-479d-9f16-8fe7821a0ef8',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.470402] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.470698] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.470698] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.470892] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.494723] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.495017] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.495265] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.495391] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.495628] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.495769] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.495871] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 388683b1-8e17-479d-9f16-8fe7821a0ef8 is going to be updated. [ 1302.528600] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.528752] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.528791] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.528994] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.529150] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.537193] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 388683b1-8e17-479d-9f16-8fe7821a0ef8 in Status: IN_PROGRESS for 2s [ 1303.876640] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 527aa039-9b45-4682-bffb-ac71e24551a1 in Status: SUCCESS [ 1303.876964] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.877076] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.877303] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.877499] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.877614] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.877679] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.877826] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.877906] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.877990] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.878101] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('527aa039-9b45-4682-bffb-ac71e24551a1',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.380597] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('527aa039-9b45-4682-bffb-ac71e24551a1',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.545829] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 388683b1-8e17-479d-9f16-8fe7821a0ef8 in Status: SUCCESS [ 1304.546082] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 388683b1-8e17-479d-9f16-8fe7821a0ef8 deletion is rescheduled due to dependency. [ 1304.546185] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-388683b1-8e17-479d-9f16-8fe7821a0ef8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.881856] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 527aa039-9b45-4682-bffb-ac71e24551a1: rpc.has_security_group_logging(os_id): False [ 1304.899478] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.899650] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.899703] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.899896] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.900079] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.900237] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.900344] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.900409] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.900559] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.900636] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.900726] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 527aa039-9b45-4682-bffb-ac71e24551a1 is going to be updated. [ 1304.958213] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.958443] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.958443] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.958787] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.958997] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.972048] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 527aa039-9b45-4682-bffb-ac71e24551a1 in Status: IN_PROGRESS for 2s [ 1306.964326] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1306.964722] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1306.986694] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 527aa039-9b45-4682-bffb-ac71e24551a1 in Status: SUCCESS [ 1306.986931] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.372789] env[70764]: INFO networking_nsxv3.common.synchronization [None req-bf530fcb-8f5f-4f21-94e8-bebe156c8d8c tempest-AttachInterfacesTestJSON-1880347664 tempest-AttachInterfacesTestJSON-1880347664-project-member] Enqueued Resource ID: 1579137e-ec71-494f-ba7e-6654cd4061aa with Priority: HIGHEST for action security_group_rules [ 1307.373338] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1579137e-ec71-494f-ba7e-6654cd4061aa with Priority: HIGHEST for action security_group_rules [ 1307.373647] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1579137e-ec71-494f-ba7e-6654cd4061aa taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.373770] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1579137e-ec71-494f-ba7e-6654cd4061aa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.373839] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1579137e-ec71-494f-ba7e-6654cd4061aa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.374288] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1579137e-ec71-494f-ba7e-6654cd4061aa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.374374] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1579137e-ec71-494f-ba7e-6654cd4061aa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.442544] env[70764]: INFO networking_nsxv3.common.synchronization [None req-7dfeca51-87f7-4e6b-adb1-4ae927b68605 tempest-AttachInterfacesTestJSON-1880347664 tempest-AttachInterfacesTestJSON-1880347664-project-member] Enqueued Resource ID: 1579137e-ec71-494f-ba7e-6654cd4061aa with Priority: HIGHEST for action security_group_rules [ 1307.443120] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1579137e-ec71-494f-ba7e-6654cd4061aa with Priority: HIGHEST for action security_group_rules [ 1307.443456] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1579137e-ec71-494f-ba7e-6654cd4061aa taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.443566] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1579137e-ec71-494f-ba7e-6654cd4061aa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.894589] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.894855] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.894855] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.895066] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.895139] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.895206] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1579137e-ec71-494f-ba7e-6654cd4061aa already deleted. [ 1307.895287] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1579137e-ec71-494f-ba7e-6654cd4061aa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.895444] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1579137e-ec71-494f-ba7e-6654cd4061aa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.895600] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1579137e-ec71-494f-ba7e-6654cd4061aa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.895685] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1579137e-ec71-494f-ba7e-6654cd4061aa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.425725] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.426052] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.426052] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.426313] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.426435] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.426557] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1579137e-ec71-494f-ba7e-6654cd4061aa already deleted. [ 1308.426661] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1579137e-ec71-494f-ba7e-6654cd4061aa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.444533] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1312.444852] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1312.887335] env[70764]: INFO networking_nsxv3.common.synchronization [req-e6ead412-16b1-40fe-83c8-2913cc00a634 req-fb25fea3-0378-47ce-a31f-5313e076f848 tempest-AttachInterfacesTestJSON-1880347664 tempest-AttachInterfacesTestJSON-1880347664-project-member] Enqueued Resource ID: 1579137e-ec71-494f-ba7e-6654cd4061aa with Priority: HIGHEST for action security_group_members [ 1312.887852] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1579137e-ec71-494f-ba7e-6654cd4061aa with Priority: HIGHEST for action security_group_members [ 1312.888445] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-1579137e-ec71-494f-ba7e-6654cd4061aa taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.888578] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1579137e-ec71-494f-ba7e-6654cd4061aa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.888647] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1579137e-ec71-494f-ba7e-6654cd4061aa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.888882] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1579137e-ec71-494f-ba7e-6654cd4061aa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.889052] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.889200] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.889251] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.889364] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.889448] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.889538] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1579137e-ec71-494f-ba7e-6654cd4061aa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.132421] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-822 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.132664] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-822" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.132760] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-822" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.133037] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-822" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.133301] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.133462] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.133592] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.133818] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.133966] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.134217] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1313.134323] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1313.134438] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1313.134556] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1313.134667] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1313.134772] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1313.134906] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1313.157259] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1313.157443] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1313.157550] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1313.157717] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-822" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.158019] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-77e9e382-8b39-4ad8-ae37-53fc07782113 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.158191] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-77e9e382-8b39-4ad8-ae37-53fc07782113" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.158312] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-77e9e382-8b39-4ad8-ae37-53fc07782113" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.158638] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-77e9e382-8b39-4ad8-ae37-53fc07782113" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.158783] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77e9e382-8b39-4ad8-ae37-53fc07782113',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.392482] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.392694] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.392694] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.392916] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.393032] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.393250] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.393357] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.393418] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.393574] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.393650] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.393734] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1579137e-ec71-494f-ba7e-6654cd4061aa already deleted. [ 1313.393815] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1579137e-ec71-494f-ba7e-6654cd4061aa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.661606] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.661606] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.662062] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.662062] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.662138] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.662237] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 77e9e382-8b39-4ad8-ae37-53fc07782113 not found, creating... [ 1313.662500] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.662665] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.662784] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.663011] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.663155] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.663433] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.663772] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.663772] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.663973] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.664125] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.664279] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 77e9e382-8b39-4ad8-ae37-53fc07782113 is going to be created. [ 1313.684124] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.684310] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.684401] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.684640] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.684861] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.685087] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-77e9e382-8b39-4ad8-ae37-53fc07782113" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.364271] env[70764]: INFO networking_nsxv3.common.synchronization [req-e6ead412-16b1-40fe-83c8-2913cc00a634 req-c4d55bd4-4438-4ffb-bdd6-894926204ddc service nova] Enqueued Resource ID: 1579137e-ec71-494f-ba7e-6654cd4061aa with Priority: HIGHEST for action security_group_rules [ 1314.364467] env[70764]: INFO networking_nsxv3.common.synchronization [req-e6ead412-16b1-40fe-83c8-2913cc00a634 req-c4d55bd4-4438-4ffb-bdd6-894926204ddc service nova] Enqueued Resource ID: 1579137e-ec71-494f-ba7e-6654cd4061aa with Priority: HIGHEST for action security_group_members [ 1314.364611] env[70764]: INFO networking_nsxv3.common.synchronization [req-e6ead412-16b1-40fe-83c8-2913cc00a634 req-c4d55bd4-4438-4ffb-bdd6-894926204ddc service nova] Enqueued Resource ID: 77e9e382-8b39-4ad8-ae37-53fc07782113 with Priority: HIGHEST for action port [ 1314.364846] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1579137e-ec71-494f-ba7e-6654cd4061aa with Priority: HIGHEST for action security_group_rules [ 1314.364999] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1579137e-ec71-494f-ba7e-6654cd4061aa with Priority: HIGHEST for action security_group_members [ 1314.365139] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77e9e382-8b39-4ad8-ae37-53fc07782113 with Priority: HIGHEST for action port [ 1314.365646] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1579137e-ec71-494f-ba7e-6654cd4061aa taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.365774] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1579137e-ec71-494f-ba7e-6654cd4061aa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.365855] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1579137e-ec71-494f-ba7e-6654cd4061aa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.366199] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1579137e-ec71-494f-ba7e-6654cd4061aa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.366355] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1579137e-ec71-494f-ba7e-6654cd4061aa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.367338] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-1579137e-ec71-494f-ba7e-6654cd4061aa taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.367509] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1579137e-ec71-494f-ba7e-6654cd4061aa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.367624] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1579137e-ec71-494f-ba7e-6654cd4061aa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.367942] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1579137e-ec71-494f-ba7e-6654cd4061aa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.368188] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.368336] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.368436] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.368627] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.368760] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.368888] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1579137e-ec71-494f-ba7e-6654cd4061aa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.369738] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-77e9e382-8b39-4ad8-ae37-53fc07782113 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.369917] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77e9e382-8b39-4ad8-ae37-53fc07782113" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.370041] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77e9e382-8b39-4ad8-ae37-53fc07782113" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.370260] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77e9e382-8b39-4ad8-ae37-53fc07782113" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.370383] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77e9e382-8b39-4ad8-ae37-53fc07782113',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.871702] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-1579137e-ec71-494f-ba7e-6654cd4061aa taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.871999] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1579137e-ec71-494f-ba7e-6654cd4061aa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.872102] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1579137e-ec71-494f-ba7e-6654cd4061aa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.873110] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 77e9e382-8b39-4ad8-ae37-53fc07782113 with status ACTIVE [ 1314.875037] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.875037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.875037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.875037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.875037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.875037] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.875037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.875037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.875037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.875037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.875037] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.875037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.875037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.875037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.875037] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.875037] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 77e9e382-8b39-4ad8-ae37-53fc07782113 is going to be updated. [ 1314.905674] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.905819] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.905866] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.906012] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.906179] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.906328] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77e9e382-8b39-4ad8-ae37-53fc07782113" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.376545] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1579137e-ec71-494f-ba7e-6654cd4061aa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.879359] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.879654] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.879654] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.879654] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.879759] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.879921] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1579137e-ec71-494f-ba7e-6654cd4061aa is going to be created. [ 1315.904457] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.904457] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.904457] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.904759] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.904843] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.915716] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1579137e-ec71-494f-ba7e-6654cd4061aa in Status: UNINITIALIZED for 2s [ 1317.931269] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1579137e-ec71-494f-ba7e-6654cd4061aa in Status: SUCCESS [ 1317.931904] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1579137e-ec71-494f-ba7e-6654cd4061aa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.931904] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1579137e-ec71-494f-ba7e-6654cd4061aa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.932139] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1579137e-ec71-494f-ba7e-6654cd4061aa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.932332] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.932452] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.932518] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.932707] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.932799] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.932904] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1579137e-ec71-494f-ba7e-6654cd4061aa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.932986] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1579137e-ec71-494f-ba7e-6654cd4061aa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.435859] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1579137e-ec71-494f-ba7e-6654cd4061aa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.937701] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1579137e-ec71-494f-ba7e-6654cd4061aa: rpc.has_security_group_logging(os_id): False [ 1318.961799] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.961799] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.961799] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.962196] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.962279] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.962614] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.962722] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.962779] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.962898] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.962976] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.963074] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1579137e-ec71-494f-ba7e-6654cd4061aa is going to be created. [ 1319.035556] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.035772] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.035772] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.035965] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.036199] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.049964] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1579137e-ec71-494f-ba7e-6654cd4061aa in Status: IN_PROGRESS for 2s [ 1319.365881] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1319.366052] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1321.063720] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1579137e-ec71-494f-ba7e-6654cd4061aa in Status: SUCCESS [ 1321.063995] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1579137e-ec71-494f-ba7e-6654cd4061aa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.223089] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.223475] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.223475] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.223561] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.223668] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1323.726370] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.228084] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.367216] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1324.367447] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1324.731203] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1324.731410] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1325.588934] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.589360] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.589360] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.589360] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.603120] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1325.603947] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.604804] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1325.646267] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.646481] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.646537] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.646736] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.658395] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.659114] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1325.659206] env[70764]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=70764) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1325.659320] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1325.699565] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.699747] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.699819] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.699960] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.700953] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.701131] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1325.786095] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.786316] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.786392] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.786595] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.786901] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.787200] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1325.878839] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.879088] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.879088] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.879252] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.879691] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.879994] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:44. [ 1325.880107] env[70764]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'388683b1-8e17-479d-9f16-8fe7821a0ef8', 'fa4fd6a5-5b80-4a63-9124-bbb06edc03a7', '90e38802-c5d5-43ce-9d13-c67ca1804885', '70063452-8c8c-4112-a7fa-5e8224b914d5', '9b7cd2f4-04ff-4e32-a598-282852b38ebb', 'f8f5efec-a14e-4be6-8add-7b35a995c982', '01588700-3c33-4723-87f1-c5abc176445e', '12f4761e-3f37-4705-a034-61d725eca2f4', 'b7bb082e-1054-4b53-b47b-6d09047c4a9e', '46c016e6-244a-4247-9a9f-a7b0e21f0989', 'e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b', '4e505537-e930-46b3-bee1-b6cba5260d3d', '7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3', '3379805b-13ae-4057-9511-570e8b3c2437', '4c1c605b-e422-421f-b86e-88a41bb1f9f4', 'b8fbd205-3cf1-4080-a3d7-9b99aeb35f70', 'bdd0180d-c388-4ba4-a117-13e93e3b0327', '2fc2deb2-a89e-4527-9c6b-7c33727bc09c', 'c0695687-32e8-4e4a-a8c8-31e6c3709596', '6df71822-ed7d-4644-87b5-30eb51293fdd', 'b963e01f-1537-47b8-8841-14ab14f97bf8', '10a6cc00-1953-4c0f-8a12-c0405294ba0f', '390854ae-4528-43fa-8fd3-61a4742be55a', '6e903658-277d-417d-95d4-4fcc19078cba', '18c40e3b-51cd-431a-858a-22168889b4fd', '82966c1e-4055-4b82-8cb6-2f08a28fcec0', '4580d502-1d18-4681-96a4-28ac4e291d69', '7a2d7e17-bca4-4474-a2c6-152a257dcccd', '46f17c96-2a3a-415a-8b88-fe6fa64e3db5', 'a9995ac6-c7bb-4911-9b05-92ca94f2c030', 'f9c2bf07-cd28-4135-994d-30a9140bcc35', '9325a264-8c44-482f-92be-005801a22ea6', '1579137e-ec71-494f-ba7e-6654cd4061aa', '56646d46-eb79-4ebc-a596-a5a17716f8e4', '6d148e57-65c0-48a3-9e3c-7f9dc3d97849', '527aa039-9b45-4682-bffb-ac71e24551a1', '025fa550-df80-4c1b-a8f7-f75221e3bef7', 'fc0ae2a8-a235-4d05-9f57-5fec83d37151', '1b95a529-ab96-4208-bb4b-7d6d16bf8877', '4bfe698a-a7e8-4922-85ee-f21b719b7edb', '5c9d913e-edf9-4026-960e-dcebaa4ea777', '433d7528-b29b-4b58-848d-9e981ea88344', '37e71aae-75a3-4784-89f9-86f606e096a1', 'dffe2468-a89e-4c09-9b45-a73f1d41f82e'} {{(pid=70764) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1325.880249] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1325.898952] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.899190] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.899190] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.899349] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.899436] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.899530] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1325.899588] env[70764]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=70764) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1325.899660] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1326.001353] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.001590] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.001590] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.001755] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.002899] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.003172] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1326.003615] env[70764]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70764) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1326.003615] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1326.003615] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1326.003615] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/44 resources of Type:Security Group Rules [ 1326.003615] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 388683b1-8e17-479d-9f16-8fe7821a0ef8 with Priority: HIGH for action security_group_rules [ 1326.003615] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fa4fd6a5-5b80-4a63-9124-bbb06edc03a7 with Priority: HIGH for action security_group_rules [ 1326.003848] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 90e38802-c5d5-43ce-9d13-c67ca1804885 with Priority: HIGH for action security_group_rules [ 1326.003848] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 with Priority: HIGH for action security_group_rules [ 1326.003848] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb with Priority: HIGH for action security_group_rules [ 1326.003848] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGH for action security_group_rules [ 1326.003992] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 01588700-3c33-4723-87f1-c5abc176445e with Priority: HIGH for action security_group_rules [ 1326.003992] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 12f4761e-3f37-4705-a034-61d725eca2f4 with Priority: HIGH for action security_group_rules [ 1326.003992] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b7bb082e-1054-4b53-b47b-6d09047c4a9e with Priority: HIGH for action security_group_rules [ 1326.004132] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 46c016e6-244a-4247-9a9f-a7b0e21f0989 with Priority: HIGH for action security_group_rules [ 1326.004132] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b with Priority: HIGH for action security_group_rules [ 1326.004272] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4e505537-e930-46b3-bee1-b6cba5260d3d with Priority: HIGH for action security_group_rules [ 1326.004311] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3 with Priority: HIGH for action security_group_rules [ 1326.004349] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGH for action security_group_rules [ 1326.004422] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4c1c605b-e422-421f-b86e-88a41bb1f9f4 with Priority: HIGH for action security_group_rules [ 1326.004485] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b8fbd205-3cf1-4080-a3d7-9b99aeb35f70 with Priority: HIGH for action security_group_rules [ 1326.004547] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bdd0180d-c388-4ba4-a117-13e93e3b0327 with Priority: HIGH for action security_group_rules [ 1326.004614] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2fc2deb2-a89e-4527-9c6b-7c33727bc09c with Priority: HIGH for action security_group_rules [ 1326.004676] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c0695687-32e8-4e4a-a8c8-31e6c3709596 with Priority: HIGH for action security_group_rules [ 1326.004737] env[70764]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6df71822-ed7d-4644-87b5-30eb51293fdd with Priority: HIGH for action security_group_rules [ 1326.004832] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.680429] env[70764]: INFO networking_nsxv3.common.synchronization [req-53b357f4-b2f4-4dbd-b6e6-4ebdfeda0bcf req-64fda2fd-e544-4b73-ae43-3e2f13bec320 tempest-AttachInterfacesTestJSON-1880347664 tempest-AttachInterfacesTestJSON-1880347664-project-member] Enqueued Resource ID: 1579137e-ec71-494f-ba7e-6654cd4061aa with Priority: HIGHEST for action security_group_members [ 1328.680994] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1579137e-ec71-494f-ba7e-6654cd4061aa with Priority: HIGHEST for action security_group_members [ 1328.681150] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 388683b1-8e17-479d-9f16-8fe7821a0ef8 with Priority: HIGH for action security_group_rules [ 1328.681295] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90e38802-c5d5-43ce-9d13-c67ca1804885 with Priority: HIGH for action security_group_rules [ 1328.681363] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01588700-3c33-4723-87f1-c5abc176445e with Priority: HIGH for action security_group_rules [ 1328.681462] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c1c605b-e422-421f-b86e-88a41bb1f9f4 with Priority: HIGH for action security_group_rules [ 1328.681565] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6df71822-ed7d-4644-87b5-30eb51293fdd with Priority: HIGH for action security_group_rules [ 1328.681658] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0695687-32e8-4e4a-a8c8-31e6c3709596 with Priority: HIGH for action security_group_rules [ 1328.681745] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fc2deb2-a89e-4527-9c6b-7c33727bc09c with Priority: HIGH for action security_group_rules [ 1328.681831] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdd0180d-c388-4ba4-a117-13e93e3b0327 with Priority: HIGH for action security_group_rules [ 1328.681934] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3379805b-13ae-4057-9511-570e8b3c2437 with Priority: HIGH for action security_group_rules [ 1328.682100] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8fbd205-3cf1-4080-a3d7-9b99aeb35f70 with Priority: HIGH for action security_group_rules [ 1328.682228] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3 with Priority: HIGH for action security_group_rules [ 1328.682323] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e505537-e930-46b3-bee1-b6cba5260d3d with Priority: HIGH for action security_group_rules [ 1328.682421] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b with Priority: HIGH for action security_group_rules [ 1328.682522] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46c016e6-244a-4247-9a9f-a7b0e21f0989 with Priority: HIGH for action security_group_rules [ 1328.682611] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7bb082e-1054-4b53-b47b-6d09047c4a9e with Priority: HIGH for action security_group_rules [ 1328.682707] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f5efec-a14e-4be6-8add-7b35a995c982 with Priority: HIGH for action security_group_rules [ 1328.682795] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12f4761e-3f37-4705-a034-61d725eca2f4 with Priority: HIGH for action security_group_rules [ 1328.682881] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb with Priority: HIGH for action security_group_rules [ 1328.682983] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa4fd6a5-5b80-4a63-9124-bbb06edc03a7 with Priority: HIGH for action security_group_rules [ 1328.683086] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 with Priority: HIGH for action security_group_rules [ 1328.683417] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-1579137e-ec71-494f-ba7e-6654cd4061aa taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.683563] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1579137e-ec71-494f-ba7e-6654cd4061aa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.683636] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1579137e-ec71-494f-ba7e-6654cd4061aa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.683835] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1579137e-ec71-494f-ba7e-6654cd4061aa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.684031] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.684160] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.684202] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.684380] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.684465] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.684569] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1579137e-ec71-494f-ba7e-6654cd4061aa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.685635] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-388683b1-8e17-479d-9f16-8fe7821a0ef8 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.685893] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-388683b1-8e17-479d-9f16-8fe7821a0ef8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.685965] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-388683b1-8e17-479d-9f16-8fe7821a0ef8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.686152] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-388683b1-8e17-479d-9f16-8fe7821a0ef8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.686260] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('388683b1-8e17-479d-9f16-8fe7821a0ef8',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.690481] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-90e38802-c5d5-43ce-9d13-c67ca1804885 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.690623] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.690692] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.690872] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.690952] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('90e38802-c5d5-43ce-9d13-c67ca1804885',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.691982] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01588700-3c33-4723-87f1-c5abc176445e taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.692253] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.692319] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.692501] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.693599] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01588700-3c33-4723-87f1-c5abc176445e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.693599] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c1c605b-e422-421f-b86e-88a41bb1f9f4 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.693599] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c1c605b-e422-421f-b86e-88a41bb1f9f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.693599] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c1c605b-e422-421f-b86e-88a41bb1f9f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.693747] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c1c605b-e422-421f-b86e-88a41bb1f9f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.693747] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c1c605b-e422-421f-b86e-88a41bb1f9f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.694967] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6df71822-ed7d-4644-87b5-30eb51293fdd taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.695095] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6df71822-ed7d-4644-87b5-30eb51293fdd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.695177] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6df71822-ed7d-4644-87b5-30eb51293fdd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.695410] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6df71822-ed7d-4644-87b5-30eb51293fdd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.695486] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6df71822-ed7d-4644-87b5-30eb51293fdd',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.696436] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0695687-32e8-4e4a-a8c8-31e6c3709596 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.696605] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0695687-32e8-4e4a-a8c8-31e6c3709596" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.696640] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0695687-32e8-4e4a-a8c8-31e6c3709596" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.696792] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0695687-32e8-4e4a-a8c8-31e6c3709596" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.696860] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0695687-32e8-4e4a-a8c8-31e6c3709596',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.698199] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2fc2deb2-a89e-4527-9c6b-7c33727bc09c taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.698303] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2fc2deb2-a89e-4527-9c6b-7c33727bc09c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.698400] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2fc2deb2-a89e-4527-9c6b-7c33727bc09c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.698527] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2fc2deb2-a89e-4527-9c6b-7c33727bc09c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.698600] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2fc2deb2-a89e-4527-9c6b-7c33727bc09c',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.699296] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdd0180d-c388-4ba4-a117-13e93e3b0327 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.699410] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdd0180d-c388-4ba4-a117-13e93e3b0327" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.699473] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdd0180d-c388-4ba4-a117-13e93e3b0327" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.699623] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdd0180d-c388-4ba4-a117-13e93e3b0327" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.699734] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdd0180d-c388-4ba4-a117-13e93e3b0327',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.700383] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3379805b-13ae-4057-9511-570e8b3c2437 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.700494] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.700560] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.700706] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.700777] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3379805b-13ae-4057-9511-570e8b3c2437',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.702582] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8fbd205-3cf1-4080-a3d7-9b99aeb35f70 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.702659] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8fbd205-3cf1-4080-a3d7-9b99aeb35f70" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.702751] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8fbd205-3cf1-4080-a3d7-9b99aeb35f70" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.702937] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8fbd205-3cf1-4080-a3d7-9b99aeb35f70" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.703050] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8fbd205-3cf1-4080-a3d7-9b99aeb35f70',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.703744] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.703845] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.703918] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.704143] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.704322] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.705072] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e505537-e930-46b3-bee1-b6cba5260d3d taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.705215] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.705305] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.705480] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.705577] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e505537-e930-46b3-bee1-b6cba5260d3d',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.706300] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.707254] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.707254] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.707254] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.707254] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.707473] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46c016e6-244a-4247-9a9f-a7b0e21f0989 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.707648] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46c016e6-244a-4247-9a9f-a7b0e21f0989" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.707648] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46c016e6-244a-4247-9a9f-a7b0e21f0989" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.707830] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46c016e6-244a-4247-9a9f-a7b0e21f0989" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.707962] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46c016e6-244a-4247-9a9f-a7b0e21f0989',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.708690] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b7bb082e-1054-4b53-b47b-6d09047c4a9e taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.708828] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b7bb082e-1054-4b53-b47b-6d09047c4a9e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.708916] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b7bb082e-1054-4b53-b47b-6d09047c4a9e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.709122] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b7bb082e-1054-4b53-b47b-6d09047c4a9e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.709214] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b7bb082e-1054-4b53-b47b-6d09047c4a9e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.709902] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8f5efec-a14e-4be6-8add-7b35a995c982 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.710041] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.710131] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.710307] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.710402] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8f5efec-a14e-4be6-8add-7b35a995c982',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.711558] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12f4761e-3f37-4705-a034-61d725eca2f4 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.711705] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.711793] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.711969] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.712091] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12f4761e-3f37-4705-a034-61d725eca2f4',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.712913] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b7cd2f4-04ff-4e32-a598-282852b38ebb taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.713049] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.713140] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.713378] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.713481] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b7cd2f4-04ff-4e32-a598-282852b38ebb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.714317] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fa4fd6a5-5b80-4a63-9124-bbb06edc03a7 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.714452] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fa4fd6a5-5b80-4a63-9124-bbb06edc03a7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.714560] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fa4fd6a5-5b80-4a63-9124-bbb06edc03a7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.714703] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fa4fd6a5-5b80-4a63-9124-bbb06edc03a7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.714800] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fa4fd6a5-5b80-4a63-9124-bbb06edc03a7',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.715789] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70063452-8c8c-4112-a7fa-5e8224b914d5 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.715882] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.715987] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.716212] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.716322] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70063452-8c8c-4112-a7fa-5e8224b914d5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.721849] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1579137e-ec71-494f-ba7e-6654cd4061aa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.745165] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.745438] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.745586] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.745898] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.748229] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.748384] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.769577] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.769708] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0695687-32e8-4e4a-a8c8-31e6c3709596 is going to be deleted. [ 1328.770626] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.770837] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.793931] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.794106] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c1c605b-e422-421f-b86e-88a41bb1f9f4 is going to be deleted. [ 1328.834561] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.834747] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.834824] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.835063] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.835289] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.835371] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0695687-32e8-4e4a-a8c8-31e6c3709596" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.847330] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.847493] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.847556] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.847853] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.847853] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.848019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c1c605b-e422-421f-b86e-88a41bb1f9f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.961382] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-822 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.961617] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-822" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.961694] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-822" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.961961] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-822" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.962233] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.962395] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.962514] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.962725] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.962890] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.963078] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1328.963194] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1328.963304] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1328.963414] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1328.963524] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1328.963631] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1328.963762] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1329.023472] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1329.023828] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.060 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1329.023828] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1329.024035] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-822" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.024445] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-b1322a65-c5b7-4b9e-b107-cc76668f38c6 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.024645] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-b1322a65-c5b7-4b9e-b107-cc76668f38c6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.024758] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-b1322a65-c5b7-4b9e-b107-cc76668f38c6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.025106] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-b1322a65-c5b7-4b9e-b107-cc76668f38c6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.025255] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1322a65-c5b7-4b9e-b107-cc76668f38c6',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.224664] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.224897] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.224897] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.225099] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.225281] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.225386] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.225455] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.225597] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.225682] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.225807] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.225878] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.243779] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1579137e-ec71-494f-ba7e-6654cd4061aa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.245627] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-70063452-8c8c-4112-a7fa-5e8224b914d5 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.245778] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.245829] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.246048] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.246226] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.246351] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.246428] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.246600] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.246696] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.246802] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.246890] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('70063452-8c8c-4112-a7fa-5e8224b914d5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.270201] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.270385] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.270431] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.270605] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.279984] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.280124] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.295216] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.295423] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.298021] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.298021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.298021] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.298021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.298021] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.298021] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.298598] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.298689] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.299363] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.299480] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.300150] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.300246] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.300912] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.301009] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.302024] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.302024] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.302463] env[70764]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1329.302928] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.303049] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.303666] env[70764]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1329.304113] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.304187] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.304804] env[70764]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1329.305229] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.305323] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.306031] env[70764]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1329.306400] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.306521] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdd0180d-c388-4ba4-a117-13e93e3b0327 is going to be deleted. [ 1329.307924] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.308033] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.308106] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.308298] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.309653] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.309753] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.341552] env[70764]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1329.342207] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.342337] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb is going to be deleted. [ 1329.343344] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.343559] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.362534] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.362534] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2fc2deb2-a89e-4527-9c6b-7c33727bc09c is going to be deleted. [ 1329.363387] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.363598] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.375619] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.375751] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.382599] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.382716] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 388683b1-8e17-479d-9f16-8fe7821a0ef8 is going to be deleted. [ 1329.383682] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.383826] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.416274] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.416420] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.422818] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.422938] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46c016e6-244a-4247-9a9f-a7b0e21f0989 is going to be deleted. [ 1329.423784] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.423984] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.475941] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.476099] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8f5efec-a14e-4be6-8add-7b35a995c982 is going to be deleted. [ 1329.477118] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.477362] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.480696] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.480786] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.486376] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.486376] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.528055] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.528055] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.528055] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.528378] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.528378] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.528537] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port b1322a65-c5b7-4b9e-b107-cc76668f38c6 not found, creating... [ 1329.528800] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.528962] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.529094] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.529317] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.529457] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.529742] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.529901] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.530032] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.530270] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.530426] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.530567] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: b1322a65-c5b7-4b9e-b107-cc76668f38c6 is going to be created. [ 1329.540492] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.540614] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01588700-3c33-4723-87f1-c5abc176445e is going to be deleted. [ 1329.541521] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.541724] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.561301] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.561483] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.580572] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.580729] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3379805b-13ae-4057-9511-570e8b3c2437 is going to be deleted. [ 1329.581600] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.581874] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.591544] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.591750] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.591849] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.592539] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.592539] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.592782] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-b1322a65-c5b7-4b9e-b107-cc76668f38c6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.633655] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.633878] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.635136] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.635271] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3 is going to be deleted. [ 1329.636140] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.636385] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.651682] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.651887] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.738395] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.746926] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.747094] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8fbd205-3cf1-4080-a3d7-9b99aeb35f70 is going to be deleted. [ 1329.748309] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.748596] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.752273] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.752404] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.752473] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.752728] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.752871] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.752969] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1579137e-ec71-494f-ba7e-6654cd4061aa is going to be updated. [ 1329.763116] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('70063452-8c8c-4112-a7fa-5e8224b914d5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.828577] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.828577] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 90e38802-c5d5-43ce-9d13-c67ca1804885 is going to be deleted. [ 1329.829810] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.829954] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.830012] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.830241] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.830323] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.830365] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3379805b-13ae-4057-9511-570e8b3c2437" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.831474] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.831474] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.836484] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.836484] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.878705] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.878865] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b7bb082e-1054-4b53-b47b-6d09047c4a9e is going to be deleted. [ 1329.879765] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.879978] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.940981] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.941193] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.941293] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.941416] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.941558] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.968499] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.968667] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.998453] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1579137e-ec71-494f-ba7e-6654cd4061aa in Status: IN_PROGRESS for 2s [ 1329.999558] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.999558] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fa4fd6a5-5b80-4a63-9124-bbb06edc03a7 is going to be deleted. [ 1330.000420] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.000785] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.057775] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.057977] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.073820] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.073948] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.102637] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.103036] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12f4761e-3f37-4705-a034-61d725eca2f4 is going to be deleted. [ 1330.103813] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.104059] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.181519] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.181782] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.189481] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.189616] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6df71822-ed7d-4644-87b5-30eb51293fdd is going to be deleted. [ 1330.190578] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.190851] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.190890] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.191042] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdd0180d-c388-4ba4-a117-13e93e3b0327" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.192114] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.192312] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.192417] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.192549] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.193763] env[70764]: INFO networking_nsxv3.common.synchronization [req-53b357f4-b2f4-4dbd-b6e6-4ebdfeda0bcf req-0918a0cf-73ca-42ef-808a-3f9229a5ffb2 service nova] Enqueued Resource ID: 1579137e-ec71-494f-ba7e-6654cd4061aa with Priority: HIGHEST for action security_group_rules [ 1330.193849] env[70764]: INFO networking_nsxv3.common.synchronization [req-53b357f4-b2f4-4dbd-b6e6-4ebdfeda0bcf req-0918a0cf-73ca-42ef-808a-3f9229a5ffb2 service nova] Enqueued Resource ID: 1579137e-ec71-494f-ba7e-6654cd4061aa with Priority: HIGHEST for action security_group_members [ 1330.194098] env[70764]: INFO networking_nsxv3.common.synchronization [req-53b357f4-b2f4-4dbd-b6e6-4ebdfeda0bcf req-0918a0cf-73ca-42ef-808a-3f9229a5ffb2 service nova] Enqueued Resource ID: b1322a65-c5b7-4b9e-b107-cc76668f38c6 with Priority: HIGHEST for action port [ 1330.194246] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.194414] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.194506] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.194643] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2fc2deb2-a89e-4527-9c6b-7c33727bc09c" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.195101] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1579137e-ec71-494f-ba7e-6654cd4061aa with Priority: HIGHEST for action security_group_rules [ 1330.195307] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1579137e-ec71-494f-ba7e-6654cd4061aa with Priority: HIGHEST for action security_group_members [ 1330.195374] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1322a65-c5b7-4b9e-b107-cc76668f38c6 with Priority: HIGHEST for action port [ 1330.195517] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.195679] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.195775] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.195910] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-388683b1-8e17-479d-9f16-8fe7821a0ef8" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.196184] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1579137e-ec71-494f-ba7e-6654cd4061aa taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.196368] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1579137e-ec71-494f-ba7e-6654cd4061aa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.196422] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1579137e-ec71-494f-ba7e-6654cd4061aa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.196590] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1579137e-ec71-494f-ba7e-6654cd4061aa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.196677] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1579137e-ec71-494f-ba7e-6654cd4061aa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.197580] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-1579137e-ec71-494f-ba7e-6654cd4061aa taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.197860] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1579137e-ec71-494f-ba7e-6654cd4061aa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.197860] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1322a65-c5b7-4b9e-b107-cc76668f38c6 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.198120] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1322a65-c5b7-4b9e-b107-cc76668f38c6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.198120] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1322a65-c5b7-4b9e-b107-cc76668f38c6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.198253] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1322a65-c5b7-4b9e-b107-cc76668f38c6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.198308] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1322a65-c5b7-4b9e-b107-cc76668f38c6',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.199151] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.199309] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.199388] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.199510] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46c016e6-244a-4247-9a9f-a7b0e21f0989" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.200050] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.200232] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.200322] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.200430] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8f5efec-a14e-4be6-8add-7b35a995c982" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.200555] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.200697] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.200773] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.200899] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01588700-3c33-4723-87f1-c5abc176445e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.201009] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.201230] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.241152] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b: rpc.has_security_group_logging(os_id): False [ 1330.264940] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 70063452-8c8c-4112-a7fa-5e8224b914d5: rpc.has_security_group_logging(os_id): False [ 1330.399580] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.399798] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.400561] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.400653] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.401316] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.401419] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.402539] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.402671] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e505537-e930-46b3-bee1-b6cba5260d3d is going to be deleted. [ 1330.403585] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.403791] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.403880] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.404057] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ade3b8b-7319-44d1-a6f3-8a9e2d0236c3" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.404155] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.404354] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.404490] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.404624] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8fbd205-3cf1-4080-a3d7-9b99aeb35f70" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.405084] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.405245] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.405329] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.405447] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-90e38802-c5d5-43ce-9d13-c67ca1804885" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.405578] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.405727] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.405806] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.405918] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b7bb082e-1054-4b53-b47b-6d09047c4a9e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.406532] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.406532] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.406532] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.406532] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fa4fd6a5-5b80-4a63-9124-bbb06edc03a7" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.406532] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.406769] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.406769] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.406830] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12f4761e-3f37-4705-a034-61d725eca2f4" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.407080] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.407080] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.432042] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.432352] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.432487] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.432553] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.432692] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.432770] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.432855] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 is going to be updated. [ 1330.433844] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.434015] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.444964] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.445096] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.481739] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.482099] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.482194] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.482248] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.482451] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.482537] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.482624] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b is going to be updated. [ 1330.483744] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.483922] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.484013] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.484150] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6df71822-ed7d-4644-87b5-30eb51293fdd" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.512547] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.512547] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.512547] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.512547] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.512547] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.512547] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e505537-e930-46b3-bee1-b6cba5260d3d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.585072] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.585072] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.585072] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.585373] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.585408] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.608443] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.608699] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.608699] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.608902] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.609038] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.623502] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 in Status: IN_PROGRESS for 2s [ 1330.636698] env[70764]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1330.637146] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b in Status: IN_PROGRESS for 2s [ 1330.700127] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-1579137e-ec71-494f-ba7e-6654cd4061aa taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.700127] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1579137e-ec71-494f-ba7e-6654cd4061aa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.700324] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b1322a65-c5b7-4b9e-b107-cc76668f38c6 with status ACTIVE [ 1330.700324] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.700403] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.700478] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.700685] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.700778] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.700948] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.701054] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.701123] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.701262] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.702023] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.702023] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.702023] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.702023] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.702023] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.702023] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.702023] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b1322a65-c5b7-4b9e-b107-cc76668f38c6 is going to be updated. [ 1330.748529] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.748992] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.748992] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.748992] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.749153] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.749329] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1322a65-c5b7-4b9e-b107-cc76668f38c6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.008092] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1579137e-ec71-494f-ba7e-6654cd4061aa in Status: SUCCESS [ 1332.008497] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1579137e-ec71-494f-ba7e-6654cd4061aa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.008497] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1579137e-ec71-494f-ba7e-6654cd4061aa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.008856] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1579137e-ec71-494f-ba7e-6654cd4061aa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.008962] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.009094] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.009165] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.009320] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.009398] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.009515] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1579137e-ec71-494f-ba7e-6654cd4061aa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.511970] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1579137e-ec71-494f-ba7e-6654cd4061aa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.635751] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 in Status: SUCCESS [ 1332.635978] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.647167] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b in Status: SUCCESS [ 1332.647367] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.014361] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1579137e-ec71-494f-ba7e-6654cd4061aa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1333.516773] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.517063] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.517063] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.517271] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.517393] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.517501] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1579137e-ec71-494f-ba7e-6654cd4061aa is going to be updated. [ 1333.542511] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.542762] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.542762] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.542960] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.543100] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.551497] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1579137e-ec71-494f-ba7e-6654cd4061aa in Status: IN_PROGRESS for 2s [ 1335.196173] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1335.197266] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1335.563051] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1579137e-ec71-494f-ba7e-6654cd4061aa in Status: SUCCESS [ 1335.563051] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1579137e-ec71-494f-ba7e-6654cd4061aa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.563051] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1579137e-ec71-494f-ba7e-6654cd4061aa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.563051] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1579137e-ec71-494f-ba7e-6654cd4061aa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.563257] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.563385] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.563385] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.563553] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.563642] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.563697] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1579137e-ec71-494f-ba7e-6654cd4061aa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.563790] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1579137e-ec71-494f-ba7e-6654cd4061aa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1336.066736] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1579137e-ec71-494f-ba7e-6654cd4061aa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1336.568350] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1579137e-ec71-494f-ba7e-6654cd4061aa: rpc.has_security_group_logging(os_id): False [ 1336.585906] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.586129] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.586129] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.586377] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.602779] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.603092] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.603215] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.603282] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.603475] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.603596] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.603666] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1579137e-ec71-494f-ba7e-6654cd4061aa is going to be updated. [ 1336.657782] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.657980] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.657980] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.658176] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.658316] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.669274] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1579137e-ec71-494f-ba7e-6654cd4061aa in Status: IN_PROGRESS for 2s [ 1338.437408] env[70764]: INFO networking_nsxv3.common.synchronization [None req-9989e56f-ef7a-478c-ad27-259fdf9a609a tempest-AttachInterfacesTestJSON-1880347664 tempest-AttachInterfacesTestJSON-1880347664-project-member] Enqueued Resource ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb with Priority: HIGHEST for action security_group_members [ 1338.437408] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb with Priority: HIGHEST for action security_group_members [ 1338.437408] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b7cd2f4-04ff-4e32-a598-282852b38ebb taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.437408] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.437408] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.437408] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.438355] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.438496] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.438634] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.438707] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.438770] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.438864] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b7cd2f4-04ff-4e32-a598-282852b38ebb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.683159] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1579137e-ec71-494f-ba7e-6654cd4061aa in Status: SUCCESS [ 1338.683384] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1579137e-ec71-494f-ba7e-6654cd4061aa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.941623] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.941780] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.941780] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.942013] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.942112] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.942333] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.942439] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.942492] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.942706] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.942798] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.942887] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb is going to be deleted. [ 1338.979868] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.980024] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.980098] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.980304] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.980397] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.980495] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.435896] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1343.436261] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1344.422275] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-853 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.422532] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-853" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.422628] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-853" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.422986] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-853" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.423393] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.423666] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.423885] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.424348] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.424585] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.424819] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1344.424938] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1344.425064] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1344.425220] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1344.425433] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1344.425630] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1344.425862] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1344.444708] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1344.445124] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1344.445124] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1344.445331] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-853" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.445472] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-f5ae992c-fe2e-4338-89fb-ecab6ef33504 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.445649] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-f5ae992c-fe2e-4338-89fb-ecab6ef33504" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.445782] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-f5ae992c-fe2e-4338-89fb-ecab6ef33504" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.446089] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-f5ae992c-fe2e-4338-89fb-ecab6ef33504" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.446234] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5ae992c-fe2e-4338-89fb-ecab6ef33504',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.949605] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.949605] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.949605] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.949943] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.949983] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.950358] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.950590] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.950727] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.950956] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.951198] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.951429] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.951599] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.951718] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.951928] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.952083] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.952230] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: f5ae992c-fe2e-4338-89fb-ecab6ef33504 is going to be updated. [ 1344.972287] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.972525] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.972642] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.972917] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.973268] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.973486] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-f5ae992c-fe2e-4338-89fb-ecab6ef33504" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.649133] env[70764]: INFO networking_nsxv3.common.synchronization [req-85dbb725-038a-4187-a9bc-d8f9ac23d4de req-bf696fd1-68a0-4f37-82d5-32491640bb83 service nova] Enqueued Resource ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b with Priority: HIGHEST for action security_group_rules [ 1345.649397] env[70764]: INFO networking_nsxv3.common.synchronization [req-85dbb725-038a-4187-a9bc-d8f9ac23d4de req-bf696fd1-68a0-4f37-82d5-32491640bb83 service nova] Enqueued Resource ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b with Priority: HIGHEST for action security_group_members [ 1345.649492] env[70764]: INFO networking_nsxv3.common.synchronization [req-85dbb725-038a-4187-a9bc-d8f9ac23d4de req-bf696fd1-68a0-4f37-82d5-32491640bb83 service nova] Enqueued Resource ID: f5ae992c-fe2e-4338-89fb-ecab6ef33504 with Priority: HIGHEST for action port [ 1345.649672] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b with Priority: HIGHEST for action security_group_rules [ 1345.649800] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b with Priority: HIGHEST for action security_group_members [ 1345.649895] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5ae992c-fe2e-4338-89fb-ecab6ef33504 with Priority: HIGHEST for action port [ 1345.650444] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.650596] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.650659] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.650844] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.650898] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.652022] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.652135] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.652201] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.652358] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.652504] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.652599] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.652666] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.652796] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.652885] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.652985] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.653684] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-f5ae992c-fe2e-4338-89fb-ecab6ef33504 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.653832] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f5ae992c-fe2e-4338-89fb-ecab6ef33504" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.653896] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f5ae992c-fe2e-4338-89fb-ecab6ef33504" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.653999] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f5ae992c-fe2e-4338-89fb-ecab6ef33504" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.654082] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5ae992c-fe2e-4338-89fb-ecab6ef33504',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.155732] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.156847] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.156956] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.157357] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f5ae992c-fe2e-4338-89fb-ecab6ef33504 with status ACTIVE [ 1346.157532] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.157643] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.157704] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.157906] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.157994] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.158176] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.158291] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.158370] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.158477] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.158554] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.158927] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.159048] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.159100] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.159252] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.160045] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.160045] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f5ae992c-fe2e-4338-89fb-ecab6ef33504 is going to be updated. [ 1346.180973] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.181151] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.181221] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.181359] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.181510] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.181639] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f5ae992c-fe2e-4338-89fb-ecab6ef33504" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.658416] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.161104] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.161351] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.161404] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.161646] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.161747] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.161851] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b is going to be updated. [ 1347.206322] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.206564] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.206615] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.206851] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.207027] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.215597] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b in Status: IN_PROGRESS for 2s [ 1349.227052] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b in Status: SUCCESS [ 1349.227052] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.227052] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.227052] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.227052] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.227557] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.227557] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.227557] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.227557] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.227557] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.227557] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.730448] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.233073] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b: rpc.has_security_group_logging(os_id): False [ 1350.252377] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.252646] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.252646] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.252808] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.252891] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.253168] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.253288] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.253362] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.253469] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.253585] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.253674] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b is going to be updated. [ 1350.314201] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.314497] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.314497] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.314757] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.314906] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.327167] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b in Status: IN_PROGRESS for 2s [ 1350.650913] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1350.651109] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1352.345542] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b in Status: SUCCESS [ 1352.345961] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.652364] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1355.652774] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1360.653484] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1360.653828] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1361.005008] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-822 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.005228] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-822" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.005420] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-822" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.005635] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-822" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.005897] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.006068] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.006188] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.006402] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.006567] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.006780] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1361.006899] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1361.007017] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1361.007127] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1361.007239] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1361.007347] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1361.007509] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1361.026993] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1361.027154] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1361.027305] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1361.027481] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-822" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.027787] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-c263db4e-109f-4552-8bda-65315bf08e63 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.027957] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-c263db4e-109f-4552-8bda-65315bf08e63" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.028093] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-c263db4e-109f-4552-8bda-65315bf08e63" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.028409] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-c263db4e-109f-4552-8bda-65315bf08e63" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.028552] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c263db4e-109f-4552-8bda-65315bf08e63',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.277337] env[70764]: INFO networking_nsxv3.common.synchronization [req-3f8c5edf-c0cd-491f-ac4e-5c6ec4f3cfd8 req-23d52abc-364f-4549-b433-2ae896a5778d tempest-ServerActionsTestOtherB-1188510512 tempest-ServerActionsTestOtherB-1188510512-project-member] Enqueued Resource ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b with Priority: HIGHEST for action security_group_members [ 1361.277745] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b with Priority: HIGHEST for action security_group_members [ 1361.278058] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.278189] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.278259] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.278516] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.278667] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.278904] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.278904] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.279050] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.279092] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.279210] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.532495] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.532741] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.532936] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.533329] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.533489] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.533708] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port c263db4e-109f-4552-8bda-65315bf08e63 not found, creating... [ 1361.533994] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.534175] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.534296] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.534709] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.534899] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.535188] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.535354] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.535476] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.535700] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.535836] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.535982] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: c263db4e-109f-4552-8bda-65315bf08e63 is going to be created. [ 1361.557349] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.557571] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.557680] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.557921] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.558158] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.558377] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-c263db4e-109f-4552-8bda-65315bf08e63" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.782542] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.782917] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.782917] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.782995] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.783110] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.783318] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.783419] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.783477] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.783624] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.783701] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.783789] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b is going to be updated. [ 1361.810102] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.810258] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.810320] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.810503] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.810638] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.819459] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b in Status: IN_PROGRESS for 2s [ 1361.997409] env[70764]: INFO networking_nsxv3.common.synchronization [req-31008e21-940a-4ae3-a8e8-982136a7427f req-be8e07ae-8456-47bb-ad1b-9c01b3f6eb10 tempest-ServerActionsTestJSON-288318646 tempest-ServerActionsTestJSON-288318646-project-member] Enqueued Resource ID: 527aa039-9b45-4682-bffb-ac71e24551a1 with Priority: HIGHEST for action security_group_members [ 1361.997943] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 527aa039-9b45-4682-bffb-ac71e24551a1 with Priority: HIGHEST for action security_group_members [ 1361.998048] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-527aa039-9b45-4682-bffb-ac71e24551a1 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.998117] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.998192] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.998384] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.998533] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.998648] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.998776] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.998852] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.998915] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.999008] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('527aa039-9b45-4682-bffb-ac71e24551a1',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.256441] env[70764]: INFO networking_nsxv3.common.synchronization [req-b0fc2da6-1d6d-4e8a-b75a-a03d3bb147f0 req-91c309de-3561-45bd-8b03-bcd83e2a6545 service nova] Enqueued Resource ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb with Priority: HIGHEST for action security_group_rules [ 1362.256719] env[70764]: INFO networking_nsxv3.common.synchronization [req-b0fc2da6-1d6d-4e8a-b75a-a03d3bb147f0 req-91c309de-3561-45bd-8b03-bcd83e2a6545 service nova] Enqueued Resource ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb with Priority: HIGHEST for action security_group_members [ 1362.256867] env[70764]: INFO networking_nsxv3.common.synchronization [req-b0fc2da6-1d6d-4e8a-b75a-a03d3bb147f0 req-91c309de-3561-45bd-8b03-bcd83e2a6545 service nova] Enqueued Resource ID: c263db4e-109f-4552-8bda-65315bf08e63 with Priority: HIGHEST for action port [ 1362.257118] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb with Priority: HIGHEST for action security_group_rules [ 1362.257247] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb with Priority: HIGHEST for action security_group_members [ 1362.257382] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c263db4e-109f-4552-8bda-65315bf08e63 with Priority: HIGHEST for action port [ 1362.257945] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b7cd2f4-04ff-4e32-a598-282852b38ebb taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.261877] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.261877] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.261877] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.261877] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b7cd2f4-04ff-4e32-a598-282852b38ebb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.263058] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b7cd2f4-04ff-4e32-a598-282852b38ebb taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.263233] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.263342] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.263564] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.263768] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.263926] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.264039] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.264394] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.264394] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.264394] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b7cd2f4-04ff-4e32-a598-282852b38ebb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.265784] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-c263db4e-109f-4552-8bda-65315bf08e63 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.266088] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c263db4e-109f-4552-8bda-65315bf08e63" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.266227] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c263db4e-109f-4552-8bda-65315bf08e63" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.266451] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c263db4e-109f-4552-8bda-65315bf08e63" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.266652] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c263db4e-109f-4552-8bda-65315bf08e63',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.500758] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.501046] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.501046] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.501215] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.522923] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.523263] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.523387] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.523447] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.523633] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.523721] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.523811] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 527aa039-9b45-4682-bffb-ac71e24551a1 is going to be updated. [ 1362.548673] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.548798] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.548798] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.548971] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.549080] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.557675] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 527aa039-9b45-4682-bffb-ac71e24551a1 in Status: IN_PROGRESS for 2s [ 1362.766521] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9b7cd2f4-04ff-4e32-a598-282852b38ebb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.768561] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c263db4e-109f-4552-8bda-65315bf08e63 with status ACTIVE [ 1362.768777] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.768915] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.768985] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.769293] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.769420] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.769598] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.769728] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.769799] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.769960] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.770050] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.770231] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.770326] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.770388] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.770527] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.770634] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.770686] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c263db4e-109f-4552-8bda-65315bf08e63 is going to be updated. [ 1362.771747] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b7cd2f4-04ff-4e32-a598-282852b38ebb taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.771841] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.791447] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.791789] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.791789] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.791872] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.791940] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.792103] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c263db4e-109f-4552-8bda-65315bf08e63" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.272574] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9b7cd2f4-04ff-4e32-a598-282852b38ebb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1363.775174] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.775326] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.775402] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.775615] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.775708] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.775807] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb is going to be created. [ 1363.799095] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.799438] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.799438] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.799533] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.799613] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.807778] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb in Status: UNINITIALIZED for 2s [ 1363.827489] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b in Status: SUCCESS [ 1363.827676] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b deletion is rescheduled due to dependency. [ 1363.827784] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e494e5b7-06cf-4e2c-b3f5-8b33932d9b3b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.567956] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 527aa039-9b45-4682-bffb-ac71e24551a1 in Status: SUCCESS [ 1364.568255] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 527aa039-9b45-4682-bffb-ac71e24551a1 deletion is rescheduled due to dependency. [ 1364.568485] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-527aa039-9b45-4682-bffb-ac71e24551a1" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.817348] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb in Status: SUCCESS [ 1365.817724] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.817776] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.817953] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.818156] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.818275] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.818340] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.818497] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.818592] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.818681] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.818770] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9b7cd2f4-04ff-4e32-a598-282852b38ebb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1366.320814] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b7cd2f4-04ff-4e32-a598-282852b38ebb taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.321047] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.321047] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.321272] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.321446] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.321551] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.321619] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.321765] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.321852] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.321941] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.322144] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b7cd2f4-04ff-4e32-a598-282852b38ebb taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.322242] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.322303] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.322440] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.322579] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.322681] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.322743] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.322878] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.322953] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.323046] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.323135] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9b7cd2f4-04ff-4e32-a598-282852b38ebb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1366.826073] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9b7cd2f4-04ff-4e32-a598-282852b38ebb: rpc.has_security_group_logging(os_id): False [ 1366.843400] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.843627] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.843679] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.843940] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.844107] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.844295] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.844385] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.844476] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.844633] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.844714] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.844907] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.845063] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.845145] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.845292] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.845369] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.845568] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.845666] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.845727] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.845867] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.845941] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.846038] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb is going to be created. [ 1366.904438] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.904679] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.904679] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.904881] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.905084] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.918199] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb in Status: IN_PROGRESS for 2s [ 1367.258239] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1367.258363] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1368.931853] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb in Status: SUCCESS [ 1368.932149] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.202014] env[70764]: INFO networking_nsxv3.common.synchronization [None req-bab48dfb-2582-4792-8873-591f451dfd55 None None] Enqueued Resource ID: 42a37fd9-1914-4e45-a3c5-e6d638bfe20d with Priority: HIGHEST for action port [ 1371.202014] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42a37fd9-1914-4e45-a3c5-e6d638bfe20d with Priority: HIGHEST for action port [ 1371.202014] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-42a37fd9-1914-4e45-a3c5-e6d638bfe20d taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.202014] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42a37fd9-1914-4e45-a3c5-e6d638bfe20d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.202014] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42a37fd9-1914-4e45-a3c5-e6d638bfe20d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.202014] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42a37fd9-1914-4e45-a3c5-e6d638bfe20d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.202014] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42a37fd9-1914-4e45-a3c5-e6d638bfe20d',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1371.703399] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 42a37fd9-1914-4e45-a3c5-e6d638bfe20d [ 1371.703643] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.703786] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.703857] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.704098] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.704192] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.704288] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:42a37fd9-1914-4e45-a3c5-e6d638bfe20d already deleted. [ 1371.704369] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42a37fd9-1914-4e45-a3c5-e6d638bfe20d" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.858275] env[70764]: INFO networking_nsxv3.common.synchronization [None req-d8154bdb-ef12-41be-ba34-dbca6c68730e tempest-ServerActionsV293TestJSON-1313533080 tempest-ServerActionsV293TestJSON-1313533080-project-member] Enqueued Resource ID: c12f461a-f952-40d0-86e4-82a261b4c35e with Priority: HIGHEST for action security_group_rules [ 1371.858840] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c12f461a-f952-40d0-86e4-82a261b4c35e with Priority: HIGHEST for action security_group_rules [ 1371.859671] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c12f461a-f952-40d0-86e4-82a261b4c35e taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.859671] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c12f461a-f952-40d0-86e4-82a261b4c35e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.859671] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c12f461a-f952-40d0-86e4-82a261b4c35e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.859671] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c12f461a-f952-40d0-86e4-82a261b4c35e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.859881] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c12f461a-f952-40d0-86e4-82a261b4c35e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1371.944751] env[70764]: INFO networking_nsxv3.common.synchronization [None req-11f32025-0918-46d7-8a64-1ab14669b842 tempest-ServerActionsV293TestJSON-1313533080 tempest-ServerActionsV293TestJSON-1313533080-project-member] Enqueued Resource ID: c12f461a-f952-40d0-86e4-82a261b4c35e with Priority: HIGHEST for action security_group_rules [ 1371.945233] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c12f461a-f952-40d0-86e4-82a261b4c35e with Priority: HIGHEST for action security_group_rules [ 1371.945488] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c12f461a-f952-40d0-86e4-82a261b4c35e taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.945591] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c12f461a-f952-40d0-86e4-82a261b4c35e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.382488] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.382791] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.382791] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.383210] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.383210] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.383210] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c12f461a-f952-40d0-86e4-82a261b4c35e already deleted. [ 1372.383374] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c12f461a-f952-40d0-86e4-82a261b4c35e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.383426] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c12f461a-f952-40d0-86e4-82a261b4c35e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.384144] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c12f461a-f952-40d0-86e4-82a261b4c35e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.384144] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c12f461a-f952-40d0-86e4-82a261b4c35e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1372.904019] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.904019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.904019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.904019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.904019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.904019] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c12f461a-f952-40d0-86e4-82a261b4c35e already deleted. [ 1372.904019] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c12f461a-f952-40d0-86e4-82a261b4c35e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.272576] env[70764]: INFO networking_nsxv3.common.synchronization [None req-0484a154-76bd-4496-a80d-3c64569a5a7b None None] Enqueued Resource ID: 6b5cdcc4-e989-45b3-b707-0b89ad58728b with Priority: HIGHEST for action port [ 1373.273283] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b5cdcc4-e989-45b3-b707-0b89ad58728b with Priority: HIGHEST for action port [ 1373.273607] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b5cdcc4-e989-45b3-b707-0b89ad58728b taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.273729] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b5cdcc4-e989-45b3-b707-0b89ad58728b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.273795] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b5cdcc4-e989-45b3-b707-0b89ad58728b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.274052] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b5cdcc4-e989-45b3-b707-0b89ad58728b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.274138] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b5cdcc4-e989-45b3-b707-0b89ad58728b',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.775883] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6b5cdcc4-e989-45b3-b707-0b89ad58728b [ 1373.776165] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.776341] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.776441] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.776767] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.776889] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.777030] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6b5cdcc4-e989-45b3-b707-0b89ad58728b already deleted. [ 1373.777143] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b5cdcc4-e989-45b3-b707-0b89ad58728b" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.901599] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-822 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.901924] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-822" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.901924] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-822" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.902222] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-822" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.902486] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.902649] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.902769] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.902982] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.903137] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.903345] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1376.903460] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1376.903570] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1376.903679] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1376.903803] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1376.903895] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1376.904037] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1376.923681] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1376.923835] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1376.923994] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1376.924154] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-822" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.924446] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-c263db4e-109f-4552-8bda-65315bf08e63 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.924629] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-c263db4e-109f-4552-8bda-65315bf08e63" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.924763] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-c263db4e-109f-4552-8bda-65315bf08e63" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.924984] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-c263db4e-109f-4552-8bda-65315bf08e63" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.925136] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c263db4e-109f-4552-8bda-65315bf08e63',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1377.427795] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.428044] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.428178] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.428453] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.428607] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.428905] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.429103] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.429226] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.429461] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.429600] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.429915] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.430097] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.430221] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.430429] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.430565] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.430709] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: c263db4e-109f-4552-8bda-65315bf08e63 is going to be updated. [ 1377.451602] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.451819] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.451952] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.452310] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.452527] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.452754] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-c263db4e-109f-4552-8bda-65315bf08e63" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.120318] env[70764]: INFO networking_nsxv3.common.synchronization [req-0517d5e9-5ba9-4e25-b150-7c89bf8e83d1 req-26114c91-7241-49ce-8539-c199256057f5 service nova] Enqueued Resource ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb with Priority: HIGHEST for action security_group_rules [ 1378.120318] env[70764]: INFO networking_nsxv3.common.synchronization [req-0517d5e9-5ba9-4e25-b150-7c89bf8e83d1 req-26114c91-7241-49ce-8539-c199256057f5 service nova] Enqueued Resource ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb with Priority: HIGHEST for action security_group_members [ 1378.120318] env[70764]: INFO networking_nsxv3.common.synchronization [req-0517d5e9-5ba9-4e25-b150-7c89bf8e83d1 req-26114c91-7241-49ce-8539-c199256057f5 service nova] Enqueued Resource ID: c263db4e-109f-4552-8bda-65315bf08e63 with Priority: HIGHEST for action port [ 1378.120318] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb with Priority: HIGHEST for action security_group_rules [ 1378.120318] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb with Priority: HIGHEST for action security_group_members [ 1378.120318] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c263db4e-109f-4552-8bda-65315bf08e63 with Priority: HIGHEST for action port [ 1378.120318] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b7cd2f4-04ff-4e32-a598-282852b38ebb taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.120318] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.120318] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.120318] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.120318] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b7cd2f4-04ff-4e32-a598-282852b38ebb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1378.121720] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b7cd2f4-04ff-4e32-a598-282852b38ebb taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.121771] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.125042] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.125042] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.125042] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.125042] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.125042] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.125042] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.125042] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.125042] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b7cd2f4-04ff-4e32-a598-282852b38ebb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1378.125042] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-c263db4e-109f-4552-8bda-65315bf08e63 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.125042] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c263db4e-109f-4552-8bda-65315bf08e63" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.125042] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c263db4e-109f-4552-8bda-65315bf08e63" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.125042] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c263db4e-109f-4552-8bda-65315bf08e63" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.125042] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c263db4e-109f-4552-8bda-65315bf08e63',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1378.625396] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b7cd2f4-04ff-4e32-a598-282852b38ebb taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.625558] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.625752] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9b7cd2f4-04ff-4e32-a598-282852b38ebb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1378.626708] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c263db4e-109f-4552-8bda-65315bf08e63 with status ACTIVE [ 1378.626909] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.627052] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.627142] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.627294] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.627382] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.627672] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.627672] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.627803] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.627878] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.627940] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.628242] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.628359] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.628433] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.628538] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.628605] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.628694] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c263db4e-109f-4552-8bda-65315bf08e63 is going to be updated. [ 1378.649734] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.649858] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.649931] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.650114] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.650237] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.650387] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c263db4e-109f-4552-8bda-65315bf08e63" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.130394] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9b7cd2f4-04ff-4e32-a598-282852b38ebb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1379.633058] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.633334] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.633334] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.633508] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.633602] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.633706] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb is going to be updated. [ 1379.661890] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.662094] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.662094] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.662255] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.662395] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.669738] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb in Status: IN_PROGRESS for 2s [ 1381.681231] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb in Status: SUCCESS [ 1381.681606] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.681606] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.681779] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.681968] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.682104] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.682174] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.682325] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.682407] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.682496] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.682589] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9b7cd2f4-04ff-4e32-a598-282852b38ebb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1382.185088] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b7cd2f4-04ff-4e32-a598-282852b38ebb taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.185327] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.185327] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.185575] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.185748] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.185859] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.185925] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.186102] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.186194] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.186322] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.186477] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b7cd2f4-04ff-4e32-a598-282852b38ebb taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.186572] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.186682] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.186864] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.187046] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.187148] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.187234] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.187405] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.187547] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.187686] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.187745] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9b7cd2f4-04ff-4e32-a598-282852b38ebb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1382.690485] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9b7cd2f4-04ff-4e32-a598-282852b38ebb: rpc.has_security_group_logging(os_id): False [ 1382.708312] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.708489] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.708545] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.708742] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.708833] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.709029] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.709131] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.709195] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.709344] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.709422] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.709603] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.709697] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.709760] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.709896] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.709969] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.710175] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.710270] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.710373] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.710553] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.710639] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.710758] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb is going to be updated. [ 1382.769649] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.769904] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.769904] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.770112] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.770265] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.790957] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb in Status: IN_PROGRESS for 2s [ 1383.119837] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1383.119940] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1384.809349] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb in Status: SUCCESS [ 1384.809705] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.120737] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1388.121063] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1393.121565] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1393.121565] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1394.166486] env[70764]: INFO networking_nsxv3.common.synchronization [req-7ce6fa69-9527-4d24-bf1f-428b865e3634 req-7f2630a6-9f12-41c4-a899-075598fc23b3 tempest-AttachInterfacesTestJSON-1880347664 tempest-AttachInterfacesTestJSON-1880347664-project-member] Enqueued Resource ID: 1579137e-ec71-494f-ba7e-6654cd4061aa with Priority: HIGHEST for action security_group_members [ 1394.167074] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1579137e-ec71-494f-ba7e-6654cd4061aa with Priority: HIGHEST for action security_group_members [ 1394.167386] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-1579137e-ec71-494f-ba7e-6654cd4061aa taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.167515] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1579137e-ec71-494f-ba7e-6654cd4061aa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.167605] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1579137e-ec71-494f-ba7e-6654cd4061aa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.167779] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1579137e-ec71-494f-ba7e-6654cd4061aa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.167954] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.168196] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.168296] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.168446] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.168558] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.168650] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1579137e-ec71-494f-ba7e-6654cd4061aa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1394.671090] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1579137e-ec71-494f-ba7e-6654cd4061aa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1395.147183] env[70764]: INFO networking_nsxv3.common.synchronization [req-3a9ae25e-8fe6-4cbc-b36d-3d83149b5d40 req-1724ace4-0910-4069-a1b2-d3ba56b67b9d tempest-ServerActionsV293TestJSON-1313533080 tempest-ServerActionsV293TestJSON-1313533080-project-member] Enqueued Resource ID: c12f461a-f952-40d0-86e4-82a261b4c35e with Priority: HIGHEST for action security_group_members [ 1395.147183] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c12f461a-f952-40d0-86e4-82a261b4c35e with Priority: HIGHEST for action security_group_members [ 1395.147420] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-c12f461a-f952-40d0-86e4-82a261b4c35e taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.147743] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c12f461a-f952-40d0-86e4-82a261b4c35e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.148498] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c12f461a-f952-40d0-86e4-82a261b4c35e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.148498] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c12f461a-f952-40d0-86e4-82a261b4c35e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.150327] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.150327] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.150327] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.150327] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.150327] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.150327] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c12f461a-f952-40d0-86e4-82a261b4c35e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1395.173699] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1579137e-ec71-494f-ba7e-6654cd4061aa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1395.421162] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-997 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.421421] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-997" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.421585] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-997" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.421951] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-997" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.422239] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.422417] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.422522] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.422744] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.422887] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.423107] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1395.423225] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1395.423335] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1395.423443] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1395.423554] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1395.423654] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1395.423788] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1395.443902] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1395.444096] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1395.444181] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1395.444329] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-997" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.444602] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-2dcdb933-4d85-4f18-ab81-29b2c19a2d49 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.444766] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-2dcdb933-4d85-4f18-ab81-29b2c19a2d49" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.444888] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-2dcdb933-4d85-4f18-ab81-29b2c19a2d49" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.445176] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-2dcdb933-4d85-4f18-ab81-29b2c19a2d49" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.445316] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2dcdb933-4d85-4f18-ab81-29b2c19a2d49',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1395.652780] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.652995] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.653084] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.653294] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.653395] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.653609] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.653712] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.653777] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.653937] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.654025] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.654109] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c12f461a-f952-40d0-86e4-82a261b4c35e already deleted. [ 1395.654190] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c12f461a-f952-40d0-86e4-82a261b4c35e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.676094] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.676249] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.676307] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.676424] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.676502] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.676593] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1579137e-ec71-494f-ba7e-6654cd4061aa is going to be updated. [ 1395.711524] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.711675] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.711722] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.711873] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.712017] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.720545] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1579137e-ec71-494f-ba7e-6654cd4061aa in Status: IN_PROGRESS for 2s [ 1395.947491] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.947724] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.947855] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.948158] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.948317] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.948474] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port 2dcdb933-4d85-4f18-ab81-29b2c19a2d49 not found, creating... [ 1395.948738] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.948900] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.949031] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.949251] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.949392] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.949663] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.949820] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.949942] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.950170] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.950307] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.950447] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: 2dcdb933-4d85-4f18-ab81-29b2c19a2d49 is going to be created. [ 1395.972581] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.972788] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.972915] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.973201] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.973432] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.973650] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-2dcdb933-4d85-4f18-ab81-29b2c19a2d49" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.629919] env[70764]: INFO networking_nsxv3.common.synchronization [req-3a9ae25e-8fe6-4cbc-b36d-3d83149b5d40 req-e1b63e03-a646-4f33-9354-6ac9e7024560 service nova] Enqueued Resource ID: c12f461a-f952-40d0-86e4-82a261b4c35e with Priority: HIGHEST for action security_group_rules [ 1396.630182] env[70764]: INFO networking_nsxv3.common.synchronization [req-3a9ae25e-8fe6-4cbc-b36d-3d83149b5d40 req-e1b63e03-a646-4f33-9354-6ac9e7024560 service nova] Enqueued Resource ID: c12f461a-f952-40d0-86e4-82a261b4c35e with Priority: HIGHEST for action security_group_members [ 1396.630299] env[70764]: INFO networking_nsxv3.common.synchronization [req-3a9ae25e-8fe6-4cbc-b36d-3d83149b5d40 req-e1b63e03-a646-4f33-9354-6ac9e7024560 service nova] Enqueued Resource ID: 2dcdb933-4d85-4f18-ab81-29b2c19a2d49 with Priority: HIGHEST for action port [ 1396.630474] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c12f461a-f952-40d0-86e4-82a261b4c35e with Priority: HIGHEST for action security_group_rules [ 1396.630595] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c12f461a-f952-40d0-86e4-82a261b4c35e with Priority: HIGHEST for action security_group_members [ 1396.630687] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dcdb933-4d85-4f18-ab81-29b2c19a2d49 with Priority: HIGHEST for action port [ 1396.631242] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c12f461a-f952-40d0-86e4-82a261b4c35e taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.631390] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c12f461a-f952-40d0-86e4-82a261b4c35e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.631433] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c12f461a-f952-40d0-86e4-82a261b4c35e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.631621] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c12f461a-f952-40d0-86e4-82a261b4c35e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.631705] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c12f461a-f952-40d0-86e4-82a261b4c35e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1396.632576] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-c12f461a-f952-40d0-86e4-82a261b4c35e taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.632688] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c12f461a-f952-40d0-86e4-82a261b4c35e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.632757] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c12f461a-f952-40d0-86e4-82a261b4c35e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.632915] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c12f461a-f952-40d0-86e4-82a261b4c35e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.633076] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.633170] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.633232] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.633370] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.633453] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.633542] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c12f461a-f952-40d0-86e4-82a261b4c35e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1396.635199] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-2dcdb933-4d85-4f18-ab81-29b2c19a2d49 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.635199] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2dcdb933-4d85-4f18-ab81-29b2c19a2d49" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.635199] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2dcdb933-4d85-4f18-ab81-29b2c19a2d49" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.635199] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2dcdb933-4d85-4f18-ab81-29b2c19a2d49" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.635199] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2dcdb933-4d85-4f18-ab81-29b2c19a2d49',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1397.137254] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-c12f461a-f952-40d0-86e4-82a261b4c35e taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.137254] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c12f461a-f952-40d0-86e4-82a261b4c35e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.137254] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c12f461a-f952-40d0-86e4-82a261b4c35e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1397.138219] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2dcdb933-4d85-4f18-ab81-29b2c19a2d49 with status ACTIVE [ 1397.138390] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.138646] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.138716] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.139044] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.139140] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.139333] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.139414] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.139474] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.139657] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.139701] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.139873] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.140022] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.140058] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.140208] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.140282] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.140371] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2dcdb933-4d85-4f18-ab81-29b2c19a2d49 is going to be updated. [ 1397.161803] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.161803] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.161803] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.161803] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.161803] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.161803] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2dcdb933-4d85-4f18-ab81-29b2c19a2d49" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.641985] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c12f461a-f952-40d0-86e4-82a261b4c35e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1397.730974] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1579137e-ec71-494f-ba7e-6654cd4061aa in Status: SUCCESS [ 1397.730974] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1579137e-ec71-494f-ba7e-6654cd4061aa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.145026] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.145026] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.145026] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.145026] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.145026] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.145026] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c12f461a-f952-40d0-86e4-82a261b4c35e is going to be created. [ 1398.172755] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.172909] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.172958] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.173176] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.173334] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.185190] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c12f461a-f952-40d0-86e4-82a261b4c35e in Status: UNINITIALIZED for 2s [ 1400.197167] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c12f461a-f952-40d0-86e4-82a261b4c35e in Status: SUCCESS [ 1400.197652] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c12f461a-f952-40d0-86e4-82a261b4c35e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.197652] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c12f461a-f952-40d0-86e4-82a261b4c35e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.197922] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c12f461a-f952-40d0-86e4-82a261b4c35e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.198377] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.198377] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.198596] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.198596] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.198696] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.198856] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c12f461a-f952-40d0-86e4-82a261b4c35e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.198856] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c12f461a-f952-40d0-86e4-82a261b4c35e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1400.578531] env[70764]: INFO networking_nsxv3.common.synchronization [req-ca44d59c-4f7f-4a1b-a529-07aff8b2ef3a req-7b104eca-8746-4930-9475-6c961ea8858b tempest-AttachInterfacesTestJSON-1880347664 tempest-AttachInterfacesTestJSON-1880347664-project-member] Enqueued Resource ID: 1579137e-ec71-494f-ba7e-6654cd4061aa with Priority: HIGHEST for action security_group_members [ 1400.580240] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1579137e-ec71-494f-ba7e-6654cd4061aa with Priority: HIGHEST for action security_group_members [ 1400.580240] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-1579137e-ec71-494f-ba7e-6654cd4061aa taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.580240] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1579137e-ec71-494f-ba7e-6654cd4061aa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.580240] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1579137e-ec71-494f-ba7e-6654cd4061aa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.580240] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1579137e-ec71-494f-ba7e-6654cd4061aa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.580240] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.580548] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.580548] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.580548] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.580646] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.580747] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1579137e-ec71-494f-ba7e-6654cd4061aa',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1400.701261] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c12f461a-f952-40d0-86e4-82a261b4c35e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1401.084071] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.084071] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.084071] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.084071] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.084071] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.084457] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.084457] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.084457] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.084457] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.084625] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.084625] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1579137e-ec71-494f-ba7e-6654cd4061aa is going to be updated. [ 1401.111534] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.111534] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.111534] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.111792] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.111792] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.119121] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1579137e-ec71-494f-ba7e-6654cd4061aa in Status: IN_PROGRESS for 2s [ 1401.203677] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c12f461a-f952-40d0-86e4-82a261b4c35e: rpc.has_security_group_logging(os_id): False [ 1401.220184] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.220367] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.220451] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.220714] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.220847] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.221158] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.221313] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.221387] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.221597] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.221703] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.221824] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c12f461a-f952-40d0-86e4-82a261b4c35e is going to be created. [ 1401.282707] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.282948] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.282948] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.283139] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.283323] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.293126] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c12f461a-f952-40d0-86e4-82a261b4c35e in Status: IN_PROGRESS for 2s [ 1403.127702] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1579137e-ec71-494f-ba7e-6654cd4061aa in Status: SUCCESS [ 1403.128087] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1579137e-ec71-494f-ba7e-6654cd4061aa deletion is rescheduled due to dependency. [ 1403.128087] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1579137e-ec71-494f-ba7e-6654cd4061aa" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.305394] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c12f461a-f952-40d0-86e4-82a261b4c35e in Status: SUCCESS [ 1403.305626] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c12f461a-f952-40d0-86e4-82a261b4c35e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.071629] env[70764]: INFO networking_nsxv3.common.synchronization [None req-3f5198ca-76f0-4c4b-9334-bbadadabc5f1 tempest-AttachInterfacesTestJSON-1880347664 tempest-AttachInterfacesTestJSON-1880347664-project-member] Enqueued Resource ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb with Priority: HIGHEST for action security_group_members [ 1405.072153] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb with Priority: HIGHEST for action security_group_members [ 1405.072454] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b7cd2f4-04ff-4e32-a598-282852b38ebb taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.072575] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.072641] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.073238] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.073238] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.073238] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.073238] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.073471] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.073471] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.073471] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b7cd2f4-04ff-4e32-a598-282852b38ebb',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1405.575930] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.576205] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.576324] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.576634] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.576808] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.577130] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.577305] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.577420] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.577691] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.577838] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.577980] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb is going to be updated. [ 1405.617839] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.618088] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.618088] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.618243] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.618388] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.627679] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb in Status: IN_PROGRESS for 2s [ 1407.638200] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb in Status: SUCCESS [ 1407.638587] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b7cd2f4-04ff-4e32-a598-282852b38ebb deletion is rescheduled due to dependency. [ 1407.638587] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b7cd2f4-04ff-4e32-a598-282852b38ebb" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.684363] env[70764]: INFO networking_nsxv3.common.synchronization [req-f6d947d6-a133-4f09-a87f-6765debe7b54 req-9795b9a3-8428-435d-be55-fc5916302b79 tempest-ServerActionsTestOtherA-1368461845 tempest-ServerActionsTestOtherA-1368461845-project-member] Enqueued Resource ID: 1b95a529-ab96-4208-bb4b-7d6d16bf8877 with Priority: HIGHEST for action security_group_members [ 1409.684542] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b95a529-ab96-4208-bb4b-7d6d16bf8877 with Priority: HIGHEST for action security_group_members [ 1409.684755] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b95a529-ab96-4208-bb4b-7d6d16bf8877 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.684924] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b95a529-ab96-4208-bb4b-7d6d16bf8877" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.684996] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b95a529-ab96-4208-bb4b-7d6d16bf8877" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.685319] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b95a529-ab96-4208-bb4b-7d6d16bf8877" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.685483] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.685612] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.685683] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.685840] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.685946] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.688054] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b95a529-ab96-4208-bb4b-7d6d16bf8877',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.189974] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.190193] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.190193] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.190409] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.212185] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.212417] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.212530] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.212599] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.212775] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.212859] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.212950] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b95a529-ab96-4208-bb4b-7d6d16bf8877 is going to be updated. [ 1410.239152] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.239306] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.239306] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.239463] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.239589] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.247680] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b95a529-ab96-4208-bb4b-7d6d16bf8877 in Status: IN_PROGRESS for 2s [ 1412.258520] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b95a529-ab96-4208-bb4b-7d6d16bf8877 in Status: SUCCESS [ 1412.258945] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b95a529-ab96-4208-bb4b-7d6d16bf8877 deletion is rescheduled due to dependency. [ 1412.258945] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b95a529-ab96-4208-bb4b-7d6d16bf8877" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.685443] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1414.685841] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1418.854268] env[70764]: INFO networking_nsxv3.common.synchronization [req-d8417700-4ccc-457b-9ced-78d53615bd77 req-b5619abf-f76f-4a5a-bdc3-f53277c665ec tempest-ServerActionsTestOtherA-1368461845 tempest-ServerActionsTestOtherA-1368461845-project-member] Enqueued Resource ID: 9325a264-8c44-482f-92be-005801a22ea6 with Priority: HIGHEST for action security_group_members [ 1418.854268] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9325a264-8c44-482f-92be-005801a22ea6 with Priority: HIGHEST for action security_group_members [ 1418.854268] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9325a264-8c44-482f-92be-005801a22ea6 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.854690] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.854690] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1418.854690] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1418.854837] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.854904] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.854959] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1418.855103] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1418.855188] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1418.855278] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9325a264-8c44-482f-92be-005801a22ea6',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1419.103129] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-388 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.103343] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-388" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.103472] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-388" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.103746] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-388" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.104016] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.104213] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.104339] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.104554] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.104701] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.104914] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1419.105129] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1419.105264] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1419.105378] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1419.105496] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1419.105605] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1419.105740] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1419.125778] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1419.126031] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1419.126131] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1419.126269] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-388" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.126557] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-a0e13dcc-3f6e-4ae3-9be7-080cda023746 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.126718] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-a0e13dcc-3f6e-4ae3-9be7-080cda023746" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.126838] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-a0e13dcc-3f6e-4ae3-9be7-080cda023746" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.127165] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-a0e13dcc-3f6e-4ae3-9be7-080cda023746" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.127309] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0e13dcc-3f6e-4ae3-9be7-080cda023746',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1419.357503] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.357795] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.357795] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.357944] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.388806] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.389052] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.389177] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.389246] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.389432] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.389514] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.389606] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9325a264-8c44-482f-92be-005801a22ea6 is going to be updated. [ 1419.423255] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.423413] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.423456] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.423680] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.423830] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.432016] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9325a264-8c44-482f-92be-005801a22ea6 in Status: IN_PROGRESS for 2s [ 1419.629707] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.630064] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.630064] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.630331] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.630486] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.630662] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port a0e13dcc-3f6e-4ae3-9be7-080cda023746 not found, creating... [ 1419.630950] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.631062] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.631196] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.631402] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.631543] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.631827] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.631982] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.632115] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.632329] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.632454] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.632658] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: a0e13dcc-3f6e-4ae3-9be7-080cda023746 is going to be created. [ 1419.652300] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.652467] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.652613] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.652814] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.653045] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.653270] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-a0e13dcc-3f6e-4ae3-9be7-080cda023746" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.312881] env[70764]: INFO networking_nsxv3.common.synchronization [req-d8417700-4ccc-457b-9ced-78d53615bd77 req-bb08176d-cdfa-4e40-94d0-6a78f82cd751 service nova] Enqueued Resource ID: 9325a264-8c44-482f-92be-005801a22ea6 with Priority: HIGHEST for action security_group_rules [ 1420.313176] env[70764]: INFO networking_nsxv3.common.synchronization [req-d8417700-4ccc-457b-9ced-78d53615bd77 req-bb08176d-cdfa-4e40-94d0-6a78f82cd751 service nova] Enqueued Resource ID: 9325a264-8c44-482f-92be-005801a22ea6 with Priority: HIGHEST for action security_group_members [ 1420.313336] env[70764]: INFO networking_nsxv3.common.synchronization [req-d8417700-4ccc-457b-9ced-78d53615bd77 req-bb08176d-cdfa-4e40-94d0-6a78f82cd751 service nova] Enqueued Resource ID: a0e13dcc-3f6e-4ae3-9be7-080cda023746 with Priority: HIGHEST for action port [ 1420.313438] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9325a264-8c44-482f-92be-005801a22ea6 with Priority: HIGHEST for action security_group_rules [ 1420.313563] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9325a264-8c44-482f-92be-005801a22ea6 with Priority: HIGHEST for action security_group_members [ 1420.313660] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0e13dcc-3f6e-4ae3-9be7-080cda023746 with Priority: HIGHEST for action port [ 1420.314235] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9325a264-8c44-482f-92be-005801a22ea6 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.314413] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.314480] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.314673] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.314753] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9325a264-8c44-482f-92be-005801a22ea6',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1420.315550] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9325a264-8c44-482f-92be-005801a22ea6 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.315642] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.315828] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-a0e13dcc-3f6e-4ae3-9be7-080cda023746 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.315928] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a0e13dcc-3f6e-4ae3-9be7-080cda023746" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.316018] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a0e13dcc-3f6e-4ae3-9be7-080cda023746" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.316211] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a0e13dcc-3f6e-4ae3-9be7-080cda023746" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.316349] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0e13dcc-3f6e-4ae3-9be7-080cda023746',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1420.817967] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9325a264-8c44-482f-92be-005801a22ea6 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.818180] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.820530] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a0e13dcc-3f6e-4ae3-9be7-080cda023746 with status ACTIVE [ 1420.820757] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.820918] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.820997] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.821216] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.821304] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.821539] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.821716] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.821716] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.821785] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.821884] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.822017] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.822109] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.822168] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.822296] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.822370] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.822452] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a0e13dcc-3f6e-4ae3-9be7-080cda023746 is going to be updated. [ 1420.843484] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.843654] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.843654] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.843801] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.843919] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.844086] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a0e13dcc-3f6e-4ae3-9be7-080cda023746" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.440945] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9325a264-8c44-482f-92be-005801a22ea6 in Status: SUCCESS [ 1421.441248] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9325a264-8c44-482f-92be-005801a22ea6 deletion is rescheduled due to dependency. [ 1421.441248] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.441413] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.441625] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.441811] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.441926] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.441991] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.442178] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.442261] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.442357] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9325a264-8c44-482f-92be-005801a22ea6',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1421.944648] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9325a264-8c44-482f-92be-005801a22ea6',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1422.446727] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9325a264-8c44-482f-92be-005801a22ea6',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1422.951143] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1422.951143] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1422.951143] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1422.951143] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1422.951143] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1422.951143] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9325a264-8c44-482f-92be-005801a22ea6 is going to be updated. [ 1422.983927] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1422.984088] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1422.984149] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1422.984350] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1422.984502] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1422.992199] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9325a264-8c44-482f-92be-005801a22ea6 in Status: IN_PROGRESS for 2s [ 1425.002463] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9325a264-8c44-482f-92be-005801a22ea6 in Status: SUCCESS [ 1425.002839] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1425.002839] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1425.003369] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1425.003369] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1425.003369] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1425.003599] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1425.003599] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1425.003707] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1425.003743] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1425.003819] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9325a264-8c44-482f-92be-005801a22ea6',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1425.314281] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1425.314388] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1425.506440] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9325a264-8c44-482f-92be-005801a22ea6 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1425.506687] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1425.506687] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1425.506836] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1425.507048] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1425.507164] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1425.507239] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1425.507387] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1425.507477] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1425.507568] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1425.507720] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9325a264-8c44-482f-92be-005801a22ea6 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1425.507810] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1425.507878] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1425.508033] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1425.508201] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1425.508304] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1425.508358] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1425.508486] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1425.508560] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1425.508642] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1425.508731] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9325a264-8c44-482f-92be-005801a22ea6',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1426.011529] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9325a264-8c44-482f-92be-005801a22ea6: rpc.has_security_group_logging(os_id): False [ 1426.029372] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1426.029568] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1426.029616] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1426.029789] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1426.029881] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1426.030097] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1426.030201] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1426.030260] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1426.030409] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1426.030484] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1426.030670] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1426.030763] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1426.030873] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1426.030961] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1426.031043] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1426.031220] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1426.031315] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1426.031364] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1426.031500] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1426.031571] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1426.031655] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9325a264-8c44-482f-92be-005801a22ea6 is going to be updated. [ 1426.094215] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1426.094388] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1426.094388] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1426.094542] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1426.094682] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1426.105608] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9325a264-8c44-482f-92be-005801a22ea6 in Status: IN_PROGRESS for 2s [ 1427.626069] env[70764]: INFO networking_nsxv3.common.synchronization [req-d39f0f19-2db7-4151-a11f-5ebec8407650 req-0b41c5b2-6036-4b73-87ce-ac643a131ade tempest-ServerActionsTestOtherA-1368461845 tempest-ServerActionsTestOtherA-1368461845-project-member] Enqueued Resource ID: 9325a264-8c44-482f-92be-005801a22ea6 with Priority: HIGHEST for action security_group_members [ 1427.626949] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9325a264-8c44-482f-92be-005801a22ea6 with Priority: HIGHEST for action security_group_members [ 1427.626949] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-9325a264-8c44-482f-92be-005801a22ea6 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1427.627123] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1427.627123] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1427.627304] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1427.627463] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1427.627561] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1427.627632] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1427.627768] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1427.627864] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1427.627961] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9325a264-8c44-482f-92be-005801a22ea6',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1427.667900] env[70764]: INFO networking_nsxv3.common.synchronization [req-d39f0f19-2db7-4151-a11f-5ebec8407650 req-0b41c5b2-6036-4b73-87ce-ac643a131ade tempest-ServerActionsTestOtherA-1368461845 tempest-ServerActionsTestOtherA-1368461845-project-member] Enqueued Resource ID: a0e13dcc-3f6e-4ae3-9be7-080cda023746 with Priority: HIGHEST for action port [ 1427.668403] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0e13dcc-3f6e-4ae3-9be7-080cda023746 with Priority: HIGHEST for action port [ 1427.668707] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-a0e13dcc-3f6e-4ae3-9be7-080cda023746 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1427.668829] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a0e13dcc-3f6e-4ae3-9be7-080cda023746" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1427.668890] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a0e13dcc-3f6e-4ae3-9be7-080cda023746" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1427.669119] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a0e13dcc-3f6e-4ae3-9be7-080cda023746" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1427.669204] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0e13dcc-3f6e-4ae3-9be7-080cda023746',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1428.120011] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9325a264-8c44-482f-92be-005801a22ea6 in Status: SUCCESS [ 1428.120011] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.130626] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.130808] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1428.130854] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1428.131130] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1428.131232] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.131446] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.131549] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1428.131610] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1428.131772] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1428.131849] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.131934] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9325a264-8c44-482f-92be-005801a22ea6 is going to be updated. [ 1428.156761] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.156761] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1428.156761] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1428.157155] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1428.157384] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.165180] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9325a264-8c44-482f-92be-005801a22ea6 in Status: IN_PROGRESS for 2s [ 1428.171571] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a0e13dcc-3f6e-4ae3-9be7-080cda023746 with status ACTIVE [ 1428.171878] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.172081] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1428.172196] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1428.172491] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1428.172653] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.172934] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.173140] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1428.173259] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1428.173518] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1428.173666] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.173963] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.174154] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1428.174276] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1428.174515] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1428.174678] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.174834] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a0e13dcc-3f6e-4ae3-9be7-080cda023746 is going to be updated. [ 1428.192020] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.192181] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1428.192250] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1428.192452] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1428.192585] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.192739] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a0e13dcc-3f6e-4ae3-9be7-080cda023746" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.174488] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9325a264-8c44-482f-92be-005801a22ea6 in Status: SUCCESS [ 1430.174863] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9325a264-8c44-482f-92be-005801a22ea6 deletion is rescheduled due to dependency. [ 1430.174863] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9325a264-8c44-482f-92be-005801a22ea6" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.669177] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1432.669650] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1437.670545] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1437.670953] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1442.671793] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1442.672143] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1447.672964] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1447.672964] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1450.862540] env[70764]: INFO networking_nsxv3.common.synchronization [req-3cabf9df-4dd5-4eb5-90c3-27801ba91963 req-0a7b7384-73be-47a3-b246-60132695e3fc tempest-ServerActionsTestOtherA-1368461845 tempest-ServerActionsTestOtherA-1368461845-project-member] Enqueued Resource ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 with Priority: HIGHEST for action security_group_members [ 1450.862958] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 with Priority: HIGHEST for action security_group_members [ 1450.863302] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-70063452-8c8c-4112-a7fa-5e8224b914d5 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.863470] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.863538] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.863738] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.863897] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.863989] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.864077] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.864208] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.864293] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.864386] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70063452-8c8c-4112-a7fa-5e8224b914d5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1451.114843] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock network-388 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1451.115061] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "network-388" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1451.115192] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "network-388" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1451.115499] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "network-388" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1451.115769] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1451.115936] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1451.116063] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1451.116313] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1451.116473] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1451.116691] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1451.116811] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] NeedRegenerationException {{(pid=70764) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1451.116924] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] no value, waiting for create lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1451.117047] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] value creation lock acquired {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1451.117166] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] No value present for key: 'zone-id' {{(pid=70764) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1451.117302] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Calling creation function for not-yet-present value {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1451.117449] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1451.135505] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1451.135624] env[70764]: DEBUG dogpile.cache.region [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70764) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1451.135766] env[70764]: DEBUG dogpile.lock [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Released creation lock {{(pid=70764) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1451.135924] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "network-388" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1451.136221] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock port-a241ab39-cfbb-486b-ac10-271af2c65091 taken with stack trace [, , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1451.136424] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "port-a241ab39-cfbb-486b-ac10-271af2c65091" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1451.136518] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "port-a241ab39-cfbb-486b-ac10-271af2c65091" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1451.136798] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "port-a241ab39-cfbb-486b-ac10-271af2c65091" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1451.136940] env[70764]: DEBUG networking_nsxv3.api.rpc [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a241ab39-cfbb-486b-ac10-271af2c65091',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1451.367514] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('70063452-8c8c-4112-a7fa-5e8224b914d5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1451.639033] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1451.639294] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1451.639436] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1451.639726] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1451.639878] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1451.640046] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Segment Port a241ab39-cfbb-486b-ac10-271af2c65091 not found, creating... [ 1451.640365] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1451.640548] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1451.641630] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1451.641630] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1451.641630] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1451.641630] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1451.641630] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1451.641630] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1451.642166] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1451.642166] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1451.642166] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Resource: SegmentPort with ID: a241ab39-cfbb-486b-ac10-271af2c65091 is going to be created. [ 1451.662926] env[70764]: DEBUG networking_nsxv3.common.locking [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1451.663304] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1451.663662] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1451.663867] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1451.664128] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1451.664557] env[70764]: DEBUG oslo_concurrency.lockutils [None req-4fd9e3a1-fe7a-4a67-bb5d-1994619838fb None None] Releasing lock "port-a241ab39-cfbb-486b-ac10-271af2c65091" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1451.869947] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('70063452-8c8c-4112-a7fa-5e8224b914d5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1452.338007] env[70764]: INFO networking_nsxv3.common.synchronization [req-3cabf9df-4dd5-4eb5-90c3-27801ba91963 req-42ea3631-e410-489c-9a41-3144610e34f2 service nova] Enqueued Resource ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 with Priority: HIGHEST for action security_group_rules [ 1452.338233] env[70764]: INFO networking_nsxv3.common.synchronization [req-3cabf9df-4dd5-4eb5-90c3-27801ba91963 req-42ea3631-e410-489c-9a41-3144610e34f2 service nova] Enqueued Resource ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 with Priority: HIGHEST for action security_group_members [ 1452.338377] env[70764]: INFO networking_nsxv3.common.synchronization [req-3cabf9df-4dd5-4eb5-90c3-27801ba91963 req-42ea3631-e410-489c-9a41-3144610e34f2 service nova] Enqueued Resource ID: a241ab39-cfbb-486b-ac10-271af2c65091 with Priority: HIGHEST for action port [ 1452.338645] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 with Priority: HIGHEST for action security_group_rules [ 1452.338774] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 with Priority: HIGHEST for action security_group_members [ 1452.338869] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a241ab39-cfbb-486b-ac10-271af2c65091 with Priority: HIGHEST for action port [ 1452.339454] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70063452-8c8c-4112-a7fa-5e8224b914d5 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1452.339578] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1452.339649] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1452.339848] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1452.339930] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70063452-8c8c-4112-a7fa-5e8224b914d5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1452.340749] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-70063452-8c8c-4112-a7fa-5e8224b914d5 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1452.340846] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1452.341048] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock port-a241ab39-cfbb-486b-ac10-271af2c65091 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1452.341149] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a241ab39-cfbb-486b-ac10-271af2c65091" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1452.341217] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a241ab39-cfbb-486b-ac10-271af2c65091" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1452.341380] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a241ab39-cfbb-486b-ac10-271af2c65091" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1452.341465] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a241ab39-cfbb-486b-ac10-271af2c65091',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1452.371761] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1452.371924] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1452.371971] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1452.372139] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1452.372249] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1452.372356] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 is going to be updated. [ 1452.399108] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1452.399260] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1452.399308] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1452.399450] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1452.399686] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1452.408327] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 in Status: IN_PROGRESS for 2s [ 1452.843558] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-70063452-8c8c-4112-a7fa-5e8224b914d5 taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1452.843697] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1452.845427] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a241ab39-cfbb-486b-ac10-271af2c65091 with status ACTIVE [ 1452.846027] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1452.846027] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1452.846446] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1452.846446] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1452.846446] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1452.846590] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1452.846977] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1452.846977] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1452.846977] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1452.846977] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1452.847277] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1452.847277] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1452.847277] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1452.847474] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1452.847511] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1452.847584] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a241ab39-cfbb-486b-ac10-271af2c65091 is going to be updated. [ 1452.869084] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1452.869084] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1452.869084] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1452.869084] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1452.869346] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1452.870382] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a241ab39-cfbb-486b-ac10-271af2c65091" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1452.897738] env[70764]: INFO networking_nsxv3.common.synchronization [req-4cfe2ba6-30ec-41f1-bc2c-741131d587f5 req-743129dc-ca12-4612-9859-dc6811bf7584 tempest-ServerActionsV293TestJSON-1313533080 tempest-ServerActionsV293TestJSON-1313533080-project-member] Enqueued Resource ID: c12f461a-f952-40d0-86e4-82a261b4c35e with Priority: HIGHEST for action security_group_members [ 1452.897738] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c12f461a-f952-40d0-86e4-82a261b4c35e with Priority: HIGHEST for action security_group_members [ 1452.897738] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-c12f461a-f952-40d0-86e4-82a261b4c35e taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1452.897738] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c12f461a-f952-40d0-86e4-82a261b4c35e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1452.897738] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c12f461a-f952-40d0-86e4-82a261b4c35e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1452.897738] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c12f461a-f952-40d0-86e4-82a261b4c35e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1452.897738] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1452.897738] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1452.897738] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1452.897738] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1452.897738] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1452.898283] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c12f461a-f952-40d0-86e4-82a261b4c35e',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1453.400862] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.401062] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.401122] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.401323] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.401420] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.401617] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.401718] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.401780] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.401926] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.402008] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.402099] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c12f461a-f952-40d0-86e4-82a261b4c35e is going to be updated. [ 1453.427737] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.427897] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.427955] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.428126] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.428259] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.435714] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c12f461a-f952-40d0-86e4-82a261b4c35e in Status: IN_PROGRESS for 2s [ 1454.417711] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 in Status: SUCCESS [ 1454.418078] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.418078] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.418271] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.418481] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.418606] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.418674] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.418834] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.418917] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.419032] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70063452-8c8c-4112-a7fa-5e8224b914d5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1454.921068] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('70063452-8c8c-4112-a7fa-5e8224b914d5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1455.426416] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('70063452-8c8c-4112-a7fa-5e8224b914d5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1455.444477] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c12f461a-f952-40d0-86e4-82a261b4c35e in Status: SUCCESS [ 1455.444668] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c12f461a-f952-40d0-86e4-82a261b4c35e deletion is rescheduled due to dependency. [ 1455.444750] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c12f461a-f952-40d0-86e4-82a261b4c35e" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1455.929383] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.929632] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.929632] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1455.929755] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1455.929846] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1455.929949] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 is going to be updated. [ 1455.955812] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.956038] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.956038] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1455.956224] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1455.956367] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1455.964022] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 in Status: IN_PROGRESS for 2s [ 1457.897830] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1457.898300] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1457.975233] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 in Status: SUCCESS [ 1457.975485] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1457.975645] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1457.975866] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1457.976068] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1457.976181] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1457.976260] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1457.976398] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1457.976480] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1457.976564] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1457.976656] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('70063452-8c8c-4112-a7fa-5e8224b914d5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1458.479040] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('70063452-8c8c-4112-a7fa-5e8224b914d5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1458.981429] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 70063452-8c8c-4112-a7fa-5e8224b914d5: rpc.has_security_group_logging(os_id): False [ 1458.999018] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1458.999324] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1458.999324] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1459.033486] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1459.033486] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1459.033486] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.033486] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1459.033486] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1459.033486] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1459.033486] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1459.033486] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 is going to be updated. [ 1459.055951] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.056158] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1459.056223] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1459.056408] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1459.056558] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1459.068675] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 in Status: IN_PROGRESS for 2s [ 1461.082772] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 in Status: SUCCESS [ 1461.083097] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.898880] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1462.899186] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1467.900232] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1467.900535] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1472.901414] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1472.901746] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1477.902360] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1477.902686] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1482.904166] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1482.904506] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1487.905527] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1487.905920] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1492.906835] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1492.907167] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1497.908057] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1497.908057] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1502.909796] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1502.910162] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1507.910831] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1507.911183] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1512.911717] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1512.912147] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1517.217454] env[70764]: INFO networking_nsxv3.common.synchronization [req-58ebebc8-fa00-40fb-b52c-a7571fdbd53b req-9c3c0e3c-bf74-4a6d-8ad2-6bafd9f45517 tempest-ServerActionsTestOtherA-1368461845 tempest-ServerActionsTestOtherA-1368461845-project-member] Enqueued Resource ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 with Priority: HIGHEST for action security_group_members [ 1517.218040] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 with Priority: HIGHEST for action security_group_members [ 1517.218340] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-70063452-8c8c-4112-a7fa-5e8224b914d5 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.218464] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.218532] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.218721] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.218894] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.218993] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.219063] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.219434] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.219434] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.219434] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70063452-8c8c-4112-a7fa-5e8224b914d5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1517.721671] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('70063452-8c8c-4112-a7fa-5e8224b914d5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1518.224850] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('70063452-8c8c-4112-a7fa-5e8224b914d5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1518.727772] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1518.727772] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1518.727772] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1518.727772] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1518.727772] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.727772] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 is going to be updated. [ 1518.764372] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1518.764543] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1518.764543] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1518.764853] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1518.765049] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.772959] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 in Status: IN_PROGRESS for 2s [ 1520.783743] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 in Status: SUCCESS [ 1520.784099] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.218963] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1522.218963] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1527.220300] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1527.220728] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1532.220985] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1532.221285] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1532.371087] env[70764]: INFO networking_nsxv3.common.synchronization [req-7a9c0fdd-7787-424b-898c-bb170bb41992 req-c744c3a0-df4e-4ced-9437-fd43eec254b9 tempest-ServerActionsTestOtherA-1368461845 tempest-ServerActionsTestOtherA-1368461845-project-member] Enqueued Resource ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 with Priority: HIGHEST for action security_group_members [ 1532.371970] env[70764]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 with Priority: HIGHEST for action security_group_members [ 1532.371970] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock member-70063452-8c8c-4112-a7fa-5e8224b914d5 taken with stack trace [, , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.372106] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.372106] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.372281] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.372441] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.372542] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.372602] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.372745] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.372827] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.372919] env[70764]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70063452-8c8c-4112-a7fa-5e8224b914d5',) {} {{(pid=70764) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1532.876052] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.876287] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.876287] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.876507] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.876603] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.876810] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.876914] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.876975] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.877148] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.877227] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.877316] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 is going to be updated. [ 1532.904511] env[70764]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.904651] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.904684] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.904849] env[70764]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.904974] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.912906] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 in Status: IN_PROGRESS for 2s [ 1534.262499] env[70764]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1534.262851] env[70764]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-16309c95-2afd-4e49-897f-08e44ed868ac None None] NSXv3 Agent Agent loop - iteration:4 started [ 1534.924803] env[70764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 in Status: SUCCESS [ 1534.924985] env[70764]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70063452-8c8c-4112-a7fa-5e8224b914d5 deletion is rescheduled due to dependency. [ 1534.925113] env[70764]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70063452-8c8c-4112-a7fa-5e8224b914d5" {{(pid=70764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.372143] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1537.372469] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1542.373047] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1542.373047] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1547.374222] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1547.374616] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1552.375410] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1552.375767] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1557.377152] env[70764]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1557.377152] env[70764]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0